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The  problem  of  robustness  of  adaptive  controllers  in  the  presence  of 
nonlinear  and/or  unmodeled  dynamics  is  addressed.  The  performance  and 
robustness  of  the  recently  introduced  Model  Dependent  Control  (MDC)  are 
examined  for  the  non-adaptive  case.  Adaptive  MDC  is  presented  and  the 
stability  for  application  to  linear  systems  is  investigated.  Finally,  a 
novel  adaptive  controller  is  presented  for  application  to  activated 
sludge  processes. 

The  stabilizing  and  the  Cautious  Self-Tuning  Controller  are 
introduced.  These  controllers  are  able  to  perform  effectively  in  the 
presence  of  nonlinearities  and  model  uncertainty  typical  of  industrial 
processes.  They  incorporate  a dead-beat  adaptive  controller  and  a robust 
one  independent  of  the  estimated  model.  The  robust  controller  becomes 
dominant  in  case  of  a large  plant/model  mismatch,  switching  to  the 
adaptive  controller  as  the  estimated  model  improves.  Both  controllers 
are  applicable  to  open-loop  stable  and  minimum  phase  systems. 


Simulations  with  highly  nonlinear  models  demonstrate  their  effectiveness, 
even  when  other  adaptive  controllers  give  unsatisfactory  performance. 

The  non-adaptive  MDC  method  is  revisited  so  as  to  handle 
independently  set-point  tracking  and  disturbance  rejection.  Only  two 
parameters  need  to  be  tuned  and  these  influence  directly  control  quality 
and  robustness.  It  is  proved  that  given  uncertainty  bounds  a robust  MDC 
controller  can  be  designed  even  for  open-loop  unstable  systems. 

Two  adaptive  controllers  based  on  the  MDC  methodology  are  presented. 
For  the  first,  the  MDC  tuning  parameters  are  constant,  whereas  for  the 
second  they  are  tuned  on-line  depending  on  the  estimated  model  error. 
Stability  is  established  for  both  controllers  for  application  to  linear 
time  invariant  systems.  The  adaptive  MDC  is  applicable  to  open-loop 
unstable  and/or  minimum  phase  systems. 

An  adaptive  optimal  bang-bang  control  algorithm  is  developed  that 
compensates  for  diurnal  feed  variations  in  the  activated  sludge  process 
for  wastewater  treatment.  Also,  the  Cautious  Self-Tuning  Controller  is 
employed  for  regulation  of  the  dissolved  oxygen  concentration. 
Simulations  with  an  activated  sludge  model  are  carried  out  and  the 
performance  of  both  controllers  is  studied. 


vi 


CHAPTER  I 
INTRODUCTION 


Process  control  is  concerned  with  the  manipulation  of  some  of  the 
process  inputs  so  that  the  process  outputs  achieve  certain  objectives. 
The  most  common  objectives  in  the  chemical  industry  are  set-point 
following  and  regulation.  In  designing  a controller  the  first  step  is  to 
obtain  a mathematical  model  which  describes  the  dynamic  relationship 
between  the  process  inputs  and  outputs.  Having  a model  there  is  a large 
number  of  design  methods  to  generate  control  laws.  Each  of  these  methods 
is  based  on  a specific  performance  objective  for  the  process.  Most  of 
the  controller  design  methods  are  based  on  linear  models.  This  is  due  to 
the  fact  that  linear  models  are  easily  obtained  and  that  linear 
differential  or  difference  equations  admit  analytic  solutions  which  then 
allow  the  study  of  the  closed-loop  process  performance. 

Adaptive  control  was  developed  for  cases  where  the  model  has  unknown 
parameters  or  the  parameters  change  with  the  operating  conditions.  The 
large  majority  of  adaptive  control  algorithms  are  based  on  the  following 
principles:  the  parameters  of  a linear  (or  bilinear)  model  are 
identified  on-line  using  a parameter  estimator  and  the  control  law  is 
calculated  from  the  current  parameter  estimates  as  if  they  were  the  true 
ones.  This  approach  is  called  "certainty  equivalence  adaptive  control." 
If,  in  addition,  the  parameter  estimation  error  is  used  to  tune  the 
controller,  the  approach  is  called  "cautious  adaptive  control." 

Adaptive  controllers  feature  an  important  advantage  over 
conventional  controllers.  They  are  able  to  tune  themselves  to  optimal 
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settings  and  to  retune  when  a change  occurs  in  the  process  parameters. 
This  is  where  the  best  known  adaptive  controller,  the  Self-Tuning 
Regulator  (STR),  draws  its  name  from.  The  STR  presented  in  its  final 
form  by  Astrom  and  Wittenmark  (1973)  utilizes  a minimum  variance 
controller  design  method  and  it  is  appropriate  for  regulating  stochastic 
systems.  Clarke  and  Gawthrop  (1975)  presented  an  extension  to  the  STR, 
the  Self-Tuning  Controller  (STC),  which  incorporates  input  penalization 
in  the  control  objective.  Other  important  adaptive  schemes  are  Model 
Reference  Adaptive  Control  (MRAC)  (Landau,  1981),  pole-zero  placement 
controllers  (e.g.  Wellstead  et  al.,  1979;  Astrom  and  Wittenmark,  1980) 
and  bilinear  STCs  (e.g.  Svoronos  et  al.,  1981). 

Adaptive  controllers  are  generally  based  on  on-line  identified 
linear  models.  The  stability  and  convergence  to  the  target  steady  state 
of  several  adaptive  controllers,  including  the  minimum  variance  STR  when 
applied  to  linear  systems,  were  recently  established  (e.g.  Goodwin  et 
al.,  1984).  However,  most  chemical  processes  are  Inherently  nonlinear 
due  to  nonlinear  dependence  of  reaction  rates  and  physical  properties  on 
temperature,  concentration,  pressure,  and  geometry.  Other  nonlinearities 
are  added  by  nonlinear  sensors  and  control  valves  as  well  as  by 
controller  saturation.  The  existing  linear-model-based  adaptive 
algorithms  face  several  problems  when  applied  to  highly  nonlinear 
systems.  For  instance,  the  minimum  variance  STR  may  lead  to  poor 
behavior  due  to  plant/model  mismatch  during  initialization  and  large  set 
point  or  load  changes.  One  might  very  well  observe  large  sustained 
oscillations  or  even  failure  of  the  algorithm  to  drive  the  system  to  the 
desired  set  point.  Such  incidents  have  been  reported  by  Song  et  al. 
(1984)  and  Gustafsson  (1984).  An  adaptive  controller  based  on  the 
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minimization  of  a quadratic  index  which  includes  penalty  on  control 
deviation  from  the  steady-state  value  (i.e.  Clarke  and  Gawthrop,  1975) 
can  reduce  oscillations,  but  requires  accurate  knowledge  of  the  steady- 
state  control  values;  otherwise  it  results  in  offset.  In  addition,  a 
high  value  of  penalty  results  in  sluggish  response,  which  is  unnecessary 
if  the  on-line  identified  model  is  good.  This  last  problem  is  shared  by 
STCs  based  on  the  minimization  of  a quadratic  index  which  includes 
penalty  in  the  control  velocity  (e.g.  Clarke  and  Gawthrop,  1975). 
Velocity  penalization  may  actually  result  in  increased  oscillations  as 
well.  Pole/zero  placement  adaptive  controllers  with  fixed  pole 
specifications  are  faced  with  similar  problems.  An  alternative  for  some 
nonlinear  systems  is  the  use  of  nonlinear  adaptive  controllers. 
Promising  algorithms  have  been  proposed  by  Golden  and  Ydstie  (1985)  and 
by  Gustafsson  (1984),  but  these  require  that  the  nonlinearities  be  known 
a priori  and  be  static,  conditions  seldom  fulfilled  in  practice. 

The  main  objective  of  this  work  is  to  develop  simple  and  robust 
adaptive  controllers  which  perform  satisfactorily  during  both  regulation 
and  set-point  changes  when  applied  to  systems  which  deviate  significantly 
from  the  ideal  linear  behavior. 

In  Chapters  II-IV  modifications  of  the  STC  design  are  presented 
which  enhance  the  robustness  characteristics  of  conventional  STCs. 
Chapter  II  describes  a control  scheme  which  consists  of  two  parts.  An 
adaptive  controller  which  regulates  the  system  close  to  the  operating 
steady  state  and  a robust  non-adaptive  controller  which  takes  over  when 
the  model  is  poor  or  whenever  a large  set-point  or  load  change  occurs. 
The  algorithm  switches  from  one  controller  to  the  other  depending  on  the 
magnitude  of  the  estimation  and  tracking  errors. 
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In  Chapter  III  the  same  idea  is  refined  so  that  the  transition 
between  the  two  controllers  is  smooth.  The  algorithm  retains  the 
structure  and  simplicity  of  STC.  Since  the  estimation  error  is  involved 
in  obtaining  the  control  law,  the  presented  adaptive  controller  is  called 
the  Cautious  STC  (CSTC).  In  Chapter  IV  the  CSTC  is  extended  to  multi- 
input multi-output  (MIMO)  systems. 

The  controllers  presented  in  Chapters  II-IV  can  be  applied  only  to 
open-loop  stable  and  minimum  phase  systems  with  constant  a priori  known 
time  delays.  Non-minimum  phase  systems  can  be  treated  but  this  requires 
extensive  process  knowledge.  In  Chapter  V a novel  controller  design 
methodology  is  presented,  namely  the  Model  Dependent  Control  (MDC)  which 
can  handle  open-loop  unstable  and  non-minimum  phase  systems  with  unknown 
or  perhaps  slowly  varying  time  delays.  The  non-adaptive  MDC  was 
introduced  by  Svoronos  (1986).  In  Chapter  V an  improved  version  is 
derived  which  is  able  to  handle  independently  set-point  tracking  and 
disturbance  rejection.  The  controller  robustness  is  also  studied  in  the 
case  of  model  uncertainty.  In  Chapter  VI  a certainty  equivalence  and  a 
cautious  adaptive  controller  based  on  the  MDC  methodology  are  presented. 
The  asymptotic  stability  and  convergence  of  both  controllers  when  applied 
to  linear  deterministic  systems  are  studied.  Finally,  in  Chapter  VII  an 
adaptive  optimal  bang-bang  controller  and  a cautious  bilinear  STC  are 
presented.  Both  controllers  are  specifically  designed  for  application  to 
the  activated  sludge  process  for  wastewater  treatment. 


CHAPTER  II 

A METHOD  FOR  INCLUDING  ROBUSTNESS  TO  ADAPTIVE  CONTROLLERS 


Introduction 


As  mentioned  earlier  if  a linear  model  based  adaptive  controller  is 
applied  to  a process  with  significant  nonlinearities,  it  might  fail.  The 
reason  of  failure  becomes  evident  through  the  following  arguments:  If 
the  parameter  estimates  are  poor  (as  is  often  the  case  after 
initialization)  then  the  adaptive  control  policy  which  is  based  on  these 
poor  estimates  may  generate  an  erroneous  signal  that  will  bring  the 
system  away  from  the  desired  operating  state.  Alternatively,  a large 
disturbance  or  set  point  change  may  drive  the  system  away  from  the 
desired  steady  state.  Once  away  from  it,  the  nonlinear  terms  become 
significant.  Since  the  parameter  estimator  attempts  to  fit  a local 
linear  model  to  the  process,  it  is  possible  that  the  parameter  estimates 
will  fail  to  converge  to  reasonable  values.  Erroneous  parameter 
estimates  lead  to  erroneous  control  action,  continual  application  of 
which  may  even  lead  to  instability. 

Thus,  adaptive  control  schemes  which  are  based  on  local  models 
generally  have  only  a limited  region  of  stability  around  the  desired 
steady  state.  In  this  chapter  a method  is  presented  for  modifying  Single 
Input  Single  Output  (SISO)  adaptive  control  algorithms,  which  can  greatly 
increase  this  region  of  stability. 
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In  the  development  that  follows  the  adaptive  algorithm  is  the  STR. 
Exactly  the  same  development  can  be  followed  with  other  linear  model 
based  adaptive  controllers  that  use  different  performance  objectives  such 
as  the  Clarke-Gawthrop  STC,  pole/zero  placement  algorithms  or  bilinear 
STCs. 

The  Self-Tuning  Regulator 

The  well  known  minimum  variance  STR  of  Astrom  and  Wittenmark  (1973) 
assumes  that  the  process  can  be  described  by  the  discrete-time  SISO 
model 


y(t+k+l)  = A(q-l)  y(t+k)  + B(q“l)  u(t)  + s + C'(t+k+l)  (2-1) 

A(q-l)  = ao  + q"^  + ...  + anq""^  (2-2) 

B(q-l)  = bo  + bi  q"^  + ...  + b„,q~”  (2-3) 

where  t denotes  time  in  number  of  sampling  intervals;  y and  u are  the 

sampled  system  output  and  the  control  variable,  respectively;  C'(t+k+l) 
is  a zero  mean  noise  sequence  uncorrelated  to  previous  inputs  and 
outputs;  A(q“^)  and  B(q“^)  are  polynomials  in  the  backward  shift  operator 
q (q  f(t)  = f(t-l));  s is  a load  parameter;  and  k is  the  system  dead 
time  in  number  of  sampling  intervals.  The  model  parameters  aj,  bj,  s are 
assumed  unknown  and  may  be  slowly  time-varying.  It  is,  however,  required 
that  the  deadtime  k and  upper  bounds  to  the  system  orders  n and  m be 
known  a priori. 
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The  minimum  variance  STR  attempts  to  minimize  the  performance 
measure 

J(u(t))  = E {[y(t+k+l)  (stochastic  case) 

(2-4) 

= [y(t+k+l)  -y^]^  (deterministic  case) 

where  y^j  is  the  desired  set  point  and  E is  the  expectation  operator.  To 
solve  the  minimization  problem  the  predictor  form  of  (2-1)  is  first 
obtained  by  sequentially  substituting  for  y(t+k),  y(t+k+l),  y(t+l) 

using  (2-1)  shifted  by  the  appropriate  number  of  sampling  intervals 

y(t+k+l)  = C(q-^)  y(t)  + D(q~l)  u(t)  + r + C(t+k+l)  (2-5) 


where 

C(q"^)  = cq  + q”l  + ...  + c^  q“"  (2-6) 

D(q-l)  = do  + di  q-1  + ...  + d„,^k  ; dQ  = bQ  (2-7) 

and  C(t+k+l)  is  a linear  combination  of  C(t+1),  ...,  C(t+k+l).  In  vector 
notation 

y(t+k+l)  = x(t)  + C(t+k+l)  (2-8) 

= 01^  x^(t)  + do  u(t)  + C(t+k+l) 
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where 


T 

®1  = [^0'  ‘■1’  •••>  ^n’  ^1’  ‘^2>  •••»  ^m+k» 


(2-9) 


xi'^(t)  = [y(t), 


• • • > 


y(t-n),  u(t-l),  ...,  u(t-m-k),  1] 


(2-10) 


- [9iT,  do] 


(2-11) 


x'^(t)  - [xi^(t),  u(t)j 


(2-12) 


Substitution  of  (2-8)  into  (2-4)  gives  the  minimum  variance  (MV)  control 
lav 


This  achieves  y(t+k+l)  = y^j  (or  E(y(t+k+l))  = y^j)  and,  from  a pole 
placement  point  of  view,  cancels  some  of  the  closed-loop  poles  with  the 
open-loop  zeroes  and  sets  the  rest  of  them  to  the  origin.  Thus  u*j;|Y(t) 
is  a controller  that  maximizes  speed  of  response. 

For  the  STR  the  unknown  parameter  vector  is  estimated  via  a 
recursive  estimator  and  the  current  estimates  0(t)  are  used  in  (2-13)  in 
the  place  of  the  true  parameters.  The  implemented  control  law  is 


1 

u*Mv(t)  = — [yd  - 5Ci(t)  0i) 

*^0 


(2-13) 


1 


Umv(0  = 


do(t) 


[Yd  - xi'^(t)  ei(t)] 


(2-14) 


where  the  superscript  ‘ denotes  parameter  estimate. 
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The  above  described  MV  STR  has  been  proved  recently  to  be  globally 
stable  when  applied  to  linear  systems  (Ydstie  and  Sargent,  1982;  Cordero 
and  Mayne,  1981;  Goodwin  et  al.,  1980).  It  is  a superior  controller  for 
linear  or  almost  linear  processes  but  is  unreliable  for  highly  nonlinear 
ones  and  can  lead  to  failures  of  various  types.  As  mentioned  previously 
these  failures  range  from  unacceptably  oscillatory  regulation  around  the 
set  point  to  instability.  They  are  due  to  the  high  sensitivity  of  the  MV 
control  law  on  the  estimated  model  error  which  can  be  large  when  the 
nonlinearities  become  dominant. 

It  is  noted  again  that  the  STR  of  (2-14)  is  used  as  an  example  and 
in  fact  any  other  adaptive  controller  could  be  used  in  its  place. 

The  Overall  Control  Scheme 


Suppose  that  somehow  a robust  controller  has  been  found  that, 
although  it  does  not  perform  as  well  as  the  STR  in  the  neighborhood  of 
the  steady  state  (where  the  system  is  most  of  the  time),  it  is  able  to 
drive  the  system  towards  the  desired  steady  state  after  large  deviations 
which  the  STC  cannot  handle.  Let  this  controller  be  referred  to  as  the 
"stabilizing"  controller  Ug(t).  Then  it  is  reasonable  to  control  the 
system  close  to  the  steady  state  with  the  STR  and  far  away  form  it  with 
the  "stabilizing"  controller.  To  be  more  specific,  we  say  that  the 
system  is  close  to  the  steady  state  if  both  the  measurement  error 

Sl(t)  = |y(t)  - y^l 
and  the  prediction  error 


S2(t)  = |y(t)  - y(tlt-k-l)| 
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satisfy 

Sl(t)  ^ ®lmax 


^2 ( ^ ^ ®2max 


where  Siniax  ®2max  chosen  to  be  small  fractions  of  |y^j|  (if  |yj|  4 
0)  and  can  be  taken  equal  (note  that  for  a linear  process  Sj^(t)  = S2(t)). 

The  overall  control  scheme  which  is  shown  schematically  in  Figure  2- 
1 is  as  follows: 

If  either  ej^  > e-\ or  62  > S2max>  process  is  controlled  via 

Ug(t)  but  the  STR  parameters  0 continue  to  be  updated. 

If  both  errors  are  within  their  limits,  the  process  is  controlled  by 
a velocity  bounded  STC 


a(t)  = 


'u(t-l)  + AUmax 

if 

UMv(t) 

> u(t-l)  + Au^ax 

u(t-l)  - Au„,aj, 

if 

UMv(t) 

< u(t-l)  - Au^ax 

,U)i^y(t)  Otherwise 


The  bound  can  be  absolute  or 

necessary  for  the  following  reason, 
time  invariant  feedback  control  law. 
Wittenmark  (1973)  and  in  Svoronos  et 
invariant  feedback  serious 
during  closed-loop  operation. 


relative  (Au^ax  = c|u(t-l)|)  and  is 
The  "stabilizing"  controller  is  a 
It  has  been  shown  in  Astrom  and 
(1981)  that  in  case  of  a time 

experienced 
controller 


al. 

identif lability  problems  are 
Thus,  when  the  "stabilizing 


11 


PROCESS 


PROCESS 


Figure  2-1.  The  "stabilizing"  STC. 
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reduces  62  below  S2max  respectively  and  the  STC  takes  over, 
the  parameter  estimates  might  be  completely  inappropriate  even  though 
|e2(t)|  is  small.  Therefore,  uj^y(t)  might  be  incorrect  and  if  it  were 
not  bounded,  it  might  throw  the  system  far  away  from  the  desired  steady 
state.  Alternatively,  since  the  system  is  not  far  from  the  target  steady 
state  (when  Q is  used)  large  control  velocity  should  not  be  needed.  The 
velocity  bound  provides  for  a smooth  transition  between  the  two  control 
laws . 

From  hereon  the  overall  scheme  will  be  referred  to  as  the 
"stabilizing”  STC. 


A Stabilizing  Controller 
Controller  Specifications 

Suppose  that  the  process  is  satisfactorily  controlled  by  the  STR 
around  the  desired  steady  state  (ydi>  '^dl^  that  the  parameter 
estimates  have  converged  inside  a ball  in  the  parameter  space  with  center 
the  true  parameter  vector  0' . Now  assume  that  at  some  instant  a load  or 
set  point  change  occurs  and  as  a result  the  new  steady  state  changes  to 
^yd2»  ^d2)’  Since  the  process  is  nonlinear,  the  parameters  of  the 
locally  valid  linear  model  also  change,  say  to  0". 

If  the  stabilizing  controller  Ug(t)  is  to  succeed  in  bringing  the 
system  from  steady  state  (y^^,  uji)  to  (y(j2>  '^d2^»  closed-loop  system 
must  at  least  be  locally  asymptotically  stable  at  the  new  steady  state  (a 
necessary  but  not  sufficient  condition).  This  is  equivalent  to  the 
condition  that  system  (2-1)  or  (2-5)  is  asymptotically  stable  for  0=0'' 
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and  u(t)  = Ug(t).  In  addition,  if  Ug(t)  is  to  drive  the  output  close 
enough  to  should  eliminate  steady-state  offset. 

A "stabilizing”  controller  satisfying  all  forementioned 
specifications  is  presented  next. 


Detuned  IMC  as  "Stabilizing"  Controller 


Internal  Model  Control  (IMC)  (Garcia  and  Morari,  1982;  Brosilov  and 
Tong,  1978)  provides  a simple  yet  effective  method  for  designing  robust 
controllers  for  open-loop  stable  systems.  A brief  description  of  IMC  is 
given  in  Appendix  A. 

To  develop  the  IMC  law  we  need  an  approximate,  perhaps  very  rough, 
dynamic  linear  model.  If  such  a model  is  not  available  one  can  operate 
the  process  open  loop,  but  with  excitation  added  to  the  control  variable, 
about  a steady  state  for  a limited  period  of  time.  The  estimator  can 
then  use  the  data  collected  to  estimate  the  parameters  of  model  (2-1). 
This  model  can  be  updated  from  time  to  time  using  trustworthy  models 
identified  during  the  STR  operation. 

Let  the  z-domain  version  of  the  obtained  model  be 


Y(z) 

= G(z) 

U(z) 


(2-15) 


where  Y(z),  U(z)  are  the  z-transformed  y(t),  u(t)  respectively,  and  G(z) 
is  the  model  transfer  function.  The  transfer  function  G(z)  is  factored 
as 


G(z)  = G+(z)  G_(z) 
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where  G^(z)  includes  all  the  noninvertible  elements  of  G(z).  That  is, 
the  time  delay  and  the  zeroes  on  or  outside  the  unit  circle.  Then  the 
internal  model  controller  is  given  by 

F(z) 

UiMc(z)  = E(z)  (2-16) 

G_(z)[l-G^(z)F(z)] 

where  E(z)  = Yjj(z)  - Y(z)  and  F(z)  is  a filter  which  is  included  to 
increase  robustness  and  improve  performance 


1-f 

F(z)  = Fi(z)  0 < f < 1 (2-17) 

l-fz"-*- 

where  F^(z)  satisfies  (see  Appendix  A) 

|Fi(e:i")G^(ej“)|  = 1 0 < « < n 

It  is  shown  in  Appendix  A that  there  exists  f (f„jin  < f < 1)  which 
stabilizes  the  closed-loop  system,  even  for  very  poor  process  models. 
This  is  obvious  from  (2-16)  and  (2-17),  since  as  f ->  1 the  controller 
gain  decreases  towards  zero.  Thus,  if  the  system  is  finite  gain  stable 
(bounded  input  bounded  output  stable)  the  Small  Gain  Theorem  (Desoer  and 
Vidyasagar,  1975,  p.  40)  implies  that  the  closed-loop  system  is  stable. 
It  is  also  shown  in  Appendix  A that  IMC  eliminates  offset.  Therefore, 
for  finite  gain  stable  systems  an  appropriately  tuned  IMC  law  meets  all 
specifications  set  for  the  stabilizing  controller. 

To  tune  the  "stabilizing"  IMC  uncertainty  bounds  G(z)  (see  Appendix 
A)  would  be  extremely  helpful.  If  no  such  information  is  available  a 
high  value  is  recommended  for  f which  results  in  a conservative  IMC 
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tuning.  In  contrast,  knowledge  of  the  model  uncertainty  can  be  used  to 
tune  IMC  as  needed  in  order  to  achieve  robustness  without  sacrificing 
performance.  For  open-loop  unstable  systems,  IMC  results  in  an  unstable 
closed  loop  so  it  is  not  an  appropriate  "stabilizing"  controller.  A 
robust  controller  for  these  systems  is  developed  in  Chapter  V. 

Example 

Consider  the  nonlinear  system 

y(t+l)  = 0.9  y(t)  + 0.1  u(t)  + 10  y(t)u(t) 

It  has  order  1 (n=0),  no  dead  time  (k=0)  and  the  predictor  form  is 


y(t+l|t)  = s + ao  y(t)  + Gq  u(t) 

The  STR  control  law  is 

yd  - s - ao  y(t) 

UMv(t)  = , 

bo 

Figure  2-2  demonstrates  the  performance  of  Uf^y(t).  The  system  was 
initialized  around  the  steady  state  u = y =0.  At  time  50  the  set  point 
was  changed  from  0 to  0.01  and  it  is  seen  that  Uf^y(t)  successfully 
brought  the  system  at  the  new  steady  state.  But  when  at  t = 100  a larger 
set-point  change  occurred  (0.01  ^ 0.05),  the  STC  failed  and  the  system 
became  unstable. 

The  overall  control  scheme  of  section  2.3  with  the  IMC  of  section 
2.4  used  as  the  "stabilizing"  controller,  i.e.  the  "stabilizing"  STC, 


16 


Figure  2-2.  Response  of  the  Uj^  controlled  system  to  set- 
point  changes  0 ->■  0.01  ^ 0.05. 
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performed  considerably  better.  It  succeeded  for  much  larger  set-point 
changes  as  seen  from  Figure  2-3  which  depicts  the  response  of  the  system 
when  the  second  set  point  change  was  0.01  •*  1.0. 

The  control  velocity  bound  was  = 0.01  and  the  error  bounds 
®lmax  = ®2max  ~ nominal  transfer  function  G(z)  was  obtained 
from  the  estimated  model  at  the  initial  u = y = 0 steady  state  as 


G(z) 


■ X 

z-ao 


where  aQ  ~ 0.9  bQ  = 0.1.  Since  no  information  was  considered  available 
for  the  model  uncertainy,  the  filter  parameter  was  taken  f = 0.99.  The 
time  invariant  IMG  law  is  then  given  by 


1-0.9Z-1 

UiMc(z)  = 0.1  ^ [Y(z)  - Yd(z)]  (2-18) 

1-z-l 

The  process  was  controlled  with  Q(t)  until,  at  time  t*  = 100,  ti  exceeded 
its  limit.  From  time  t = 101  to  t = 116  (until  both  errors  were  reduced 
to  within  their  limits),  the  process  was  controlled  by  the  "stabilizing” 
controller  of  (2-18). 

It  is  interesting  to  compare  the  response  of  the  overall  scheme  to 
that  of  its  components.  Figure  2-4  shows  the  closed  loop  response  when 
the  bounded  STC,  Q(t)  is  the  controller  for  all  t2-  The  second  set 

point  change  was  again  0.01  -»  1.0  and  it  is  clear  that  the  controller 
failed.  Figure  2-5  shows  how  the  IMG  alone  performs  for  the  set-point 
0.01  1.0.  It  is  seen  that  it  took  considerably  longer  than  the 

"stabilizing”  STC  to  reach  the  desired  steady  state. 
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Figure  2 3.  Response  of  the  "stabilizing"  STC  controlled 
system  to  set-point  changes  0 0.01  ^ 1. 
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Figure  2-4.  Response  of  the  u controlled  system  to  the 
set-point  changes  0 ->■  0.01  ^ 1.0. 
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Figure  2 5.  Response  of  the  IMG  controlled  system  to  the 
set-point  change  0.01  1.0. 


CHAPTER  III 

A CAUTIOUS  SELF-TUNING  CONTROLLER 
Introduction 


This  chapter  presents  a simple  linear  model  based  self-tuning 
controller,  namely  the  Cautious  Self-Tuning  Controller  (CSTC)  which 
features  enhanced  robustness  characteristics  in  the  case  of  unmodeled 
nonlinearities  and/or  dynamics.  The  controller  structure  is  that  of  a 
linear  quadratic  one  minimizing  a single-step  cost  function  with  output 
and  input  penalization.  STCs  involving  input  penalization  have  been 
proved  to  be  more  robust  than  the  STR  (Gawthrop  and  Lim,  1982)  and  are 
perhaps  the  most  industrially  accepted  adaptive  controllers  (Dumont, 
1986).  The  major  drawback  these  controllers  face  is  the  requirement  to 
know  a priori  weights  that  result  in  a closed-loop  stable  system.  For 
open-loop  stable  systems  stability  and  robustness  can  be  achieved  with 
heavy  penalization  of  the  control  variable  but  this  results  in  sluggish 
performance. 

To  circumvent  the  problem,  algorithms  involving  time-varying  weights 
tuned  on-line  have  been  presented.  Allidina  and  Hughes  (1980)  calculate 
the  weights  on-line  as  the  solution  to  pole  placement  related  Bezoutian 
equations.  Latawiec  and  Chyra  (1983)  utilize  on-line  stability  criteria 
to  adjust  the  weights.  Toivonen  (1983)  interprets  the  input  weight  as 
the  Langrange  multiplier  of  a control  variance  constrained  optimal 
control  problem.  These  algorithms  (all  developed  for  SISO  systems) 
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require  a large  amount  of  computations  which  may  become  prohibitive  in 
the  multivariable  case. 

The  CSTC  presented  here  is  a simple  self-tuning  controller  whose 
weight  is  tuned  on-line  based  on  the  estimation  error.  The  key  idea  is 
the  incorporation  of  two  parts  in  the  control  law,  a minimum  variance 
part  which  depends  directly  on  the  estimated  parameters  of  an  assumed 
linear  model  and  a ’’caution”  part  which  is  independent  of  these  estimated 
parameters.  If  the  parameter  estimates  are  poor,  the  "caution"  part  is 
dominant  and  drives  the  system  slowly  but  safely  towards  the  desired 
steady  state.  When  the  estimates  improve  to  the  point  that  the 
plant/model  mismatch  is  negligible,  the  minimum  variance  part  becomes 
dominant  and  rapidly  brings  the  system  at  the  target  steady  state  without 
large  oscillations. 

The  SISO  version  is  presented  in  this  chapter  and  the  multivariable 
in  Chapter  IV. 

The  Cautious  Self-Tuning  Controller  Structure 

The  Cautious  Self-Tuning  Controller  is  based  on  the  same  model  as 
the  STR  given  by  equations  (2-l)-(2-4)  and  (2-5)-(2-12) . However, 
recognizing  that  the  true  process  is  probably  nonlinear,  CSTC  is  only 
dependent  on  this  linear  model,  its  influence  disappearing 
whenever  it  fails  to  match  the  process  behavior. 

The  CSTC  is  based  on  a performance  index  of  the  type 


J(u(t))  = [y(t+k+l|t)  - yg]2  + q(t)  [u(t)  - 


(3-1) 
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where  the  "caution"  term  U(,(t)  is  a conservative  control  law  insensitive 
to  or  independent  of  the  estimated  model,  and  it  is  able  to  drive  the 
system  close  to  the  desired  set  point.  Possible  choices  of  are 

discussed  in  the  next  section.  The  future  estimate  y(t+k+l|t)  is  given 
by 

/ 0^0  \ 

y(t+k+l|t)  = x'T(t)  0(t) 

where  the  estimate  0(t)  is  obtained  using  a recursive  estimator.  A UDU 
factorization  (Bierman,  1977)  of  a recursive  least  squares  estimator  with 
variable  forgetting  factor  (Ydstie  and  Sargent,  1982;  Fortescue  et  al., 
1981)  is  well  suited  for  identifying  the  linear  part  of  a nonlinear 
process.  The  nonnegative  weight  q(t)  is  not  constant  but  an  increasing 
function  of  the  plant/model  mismatch,  becoming  zero  when  the  on-line 
identified  model,  describes  the  process  perfectly. 

Minimization  of  performance  measure  J with  respect  to  u(t)  results 
in 


q(t)  (3-3) 

y(t+k+l|t)  - Ys  + [u(t)  - uc(t)]  = 0 

or,  in  view  of  (3-2)  and  (2-14),  the  CSTC  control  law  is 

u(t)  = h(t)  u^(t)  + [l-h(t)l  UMv(t)  (3-4) 


where 


q(t) 

h(t)  = 

do^(t)  + q(t) 


(3-5) 
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Since  0 < h(t)  <1,  the  controller  of  (3-4)  is  a convex  combination  of 
the  terms  Uj.(t)  and  Uf^y(t).  If  the  estimated  parameter  vector  0(t) 
provides  an  accurate  description  of  the  system,  then  the  weight  q(t) 
should  be  taken  close  to  zero  and  Uf^y(t)  would  be  the  dominant  term.  In 
the  case  of  large  plant/model  mismatch  a large  value  of  q(t)  is 
appropriate  which  would  make  the  "caution"  term  Uj.(t)  dominant  and  weigh 
out  the  erroneous  Uj^y(t)  contribution.  A method  for  relating  q(t)  to 
plant/model  mismatch  is  given  next. 

Equation  (3-3)  may  be  written  alternatively  as 

q(t) 

e(t+k+l)  - e(t+k+l|t)  = - [u(t)  - u„(t)]  (3-6) 

do(t) 

where 


e(t)  - y(t)  - yg  (3_7) 

is  the  output  error,  and 

e(t|t-k-l)  = y(t)  - y(t|t-k-l) 

is  the  output  prediction  error  given  information  up  to  time  t - k - 1. 
If  a local  linear  model  is  valid,  the  output  error  is 


e(t+k+l)  = y(t+k+l)  - = dQ[u(t)  - u*„v(t)] 


(3-9) 
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where  u*j^(t)  is  given  by  (2-13)  (i.e.  it  is  based  on  the  true  parameter 
values).  Substitution  of  (3-9)  into  (3-6)  gives 


do(t)h'(t) 

u(t)  = h'(t)  Uc(t)  + [l-h'(t)]  u*Mv(t)  + e(t+k+l|t)  (3-10) 

q(t) 


where 


q(t) 

h'(t) , (3-11) 

dodo<0  + q(t) 

The  last  term  of  (3-10)  represents  the  erroneous  part  of  the  control  law 
due  to  the  inaccuracy  of  the  on-line  identified  model.  It  is  reasonable 
to  limit  that  part  to  a fraction  8 of  the  "caution"  part,  or 


|do(t)  h'(t)  I I I 

I €(t+k+lit)i  = 8 |h'(t)  Uc(t)| 

I q(t)  I 1 1 


(3-12) 


from  which  follows 
!do(t)| 

q(t)  |s(t+k+l|t)|  (3-13) 

61uc(t)| 

The  above  equation  expresses  q(t)  as  a linear  function  of  the  output 
prediction  error  s(t-»-k+l 1 1) . Since  this  error  is  unknown  at  time  t,  it 
is  substituted  by  a filtered  e(tjt-k-l).  The  filtering,  by  not  allowing 
large  sudden  drops  in  q(t),  protects  against  the  case  where,  at  some 
instant,  parameter  errors  combine  so  as  to  produce  a small  e(tjt-k-l) 
even  though  the  model  is  poor;  in  addition,  by  restricting  the  rate  of 
change  of  q(t),  filtering  smooths  out  the  control  law.  Thus,  the  weight 
q(t)  is  finally  chosen  as 
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q(t)  = 

5|Uc(t) 


|do(t)| 


v(t) 


(3-14) 


where 


v(t)  = pv(t-l)  + (1-p)  |E(t|t-k-l)|  ; 0 < p < 1 


(3-15) 


The  corresponding  h(t)  is  given  by  (3-5)  as 


v(t) 


h(t)  = 


T 


(3-16) 


5|do(t)  Uc(t)|  + v(t) 


One  final  note  is  in  order.  To  assure  that  in  (3-10)  h'(t)  e [0,1]  we 
set  h(t)  = 1 (which  implies  q(t)  -*  ® and  hence  h'(t)  = 1)  whenever  dQ(t) 
has  the  wrong  sign.  Thus,  a priori  knowledge  of  the  sign  of  dQ  is 
required. 

With  the  above  choice  of  h(t)  a large  plant/model  mismatch  drives 
h(t)  towards  1 and  hence  the  CSTC  control  law  (3-4)  towards  U(,(t).  As 
estimates  improve  the  mismatch  decreases,  h(t)  decreases  and  the  control 
approaches  Uf^y(t),  as  desired.  However,  it  should  be  mentioned  that  the 
MV  STC  runs  into  stability  problems  if  applied  to  systems  with  zeroes 
outside  the  open  unit  circle  at  the  target  steady  state.  Therefore,  the 
CSTC  should  also  not  be  used  in  such  cases. 


In  this  section  the  CSTC  design  is  completed  by  presenting  two 
possible  choices  for  the  "caution"  term  Uj,(t). 


The  "Caution"  Term 
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The  first  and  simplest  possibility  is 

(3-17) 

Ucl(t)  = Ug  + N(t) 

where  Ug  is  a constant  approximating  the  control  variable  value  at  the 
target  steady  state.  Such  an  approximate  value  is  usually  known  from 
operating  experience  or  from  a steady-state  model  available  from  the 
design  stage.  Low  level  white  noise  excitation  N(t)  is  added  to  aid  the 
parameter  estimator.  Otherwise,  identifiability  problems  which  arise  for 
a constant  or  constant  parameter  control  law  (Astrom  and  Wittenraark, 
1973)  would  be  encountered  when  h is  high.  The  excitation  component  of 
u(t)  will,  of  course,  decrease  as  the  estimated  model  improves  and  h 
drops. 

If  a constant  weight  q were  used,  an  inaccurate  Ug  would  result  in 
steady-state  offset.  However,  in  the  CSTC  case  q and  hence  the 
contribution  of  U(<3i(t)  in  u(t)  decreases  as  the  parameter  estimates 
improve  leading  ultimately  to  zero  or  insignificant  offset. 

The  second  possible  choise  for  Uj,(t)  requires  a priori  knowledge  of 
an  approximate,  perhaps  very  rough,  dynamic  linear  model.  The  "caution" 
term  is  then  designed  as  a very  conservative  IMC  similarly  to  the 
"stabilizing"  controller  described  in  section  2.4.  For  example,  if 
B(q"^)  has  no  zeroes  outside  the  open  unit  circle,  the  internal  model 
controller  for  (2-1)  is 


B(q-l)  [1-fq-l  - (l-f)q-*^-l]  Ujmc(0  = “ d-^)  [l-q'^A(q-l)]e(t)  (3-18) 
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If  the  filter  pole  f is  chosen  very  close  to  1,  is  very  conservative 

(and  sluggish)  but  will  drive  the  system  to  the  desired  steady  state, 
even  if  the  model  is  poor.  This  is  exactly  what  is  required  for  the 
"caution"  term  and  therefore  we  set 

Uc2(t)  = ui„c(t)  + N(t)  (3-19) 

It  should  be  remarked  here  that  a high  value  is  recommended  for  f, 
even  if  the  local  model  used  to  design  uj}^c(t)  adequately  represents  the 
current  state  of  process.  Since  plants  are  generally  nonlinear, 
disturbance  or  set  point  changes  may  significantly  alter  the  locally 
valid  linear  model.  The  sluggishness  of  Ujj^c(t),  and  hence  U(,2(t)»  is 
not  a serious  drawback  for  the  CSTC  as  it  might  be  for  the  "stabilizing" 
STC  of  the  previous  chapter  since  the  Uj^y(t)  component  will  speed  up  the 
system  response  as  soon  as  the  parameter  estimates,  aided  by  the 
excitation  of  Uj,2(t),  improve. 

The  "caution"  term  u^.2(t)  is  more  difficult  to  obtain  than  Uj,2(t) 
but  has  the  advantage  that  is  guarantees  complete  elimination  of  steady- 
state  offset  even  for  h different  than  zero. 

Example 

The  CSTC  performance  is  demonstrated  on  the  stirred  tank  reactor 
model  given  by  Ahlgren  and  Stevens  (1971).  The  reactor  mass  and  energy 
balances  are 

dC  Q Q 

— =-Ci-_C-  (3-20) 

dt  V V 
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dT  Q 
dt  V 


Q (-M)Ke-E/RT  UA  2p_CdcQc(T-Tc) 

_ T + C - 

^ PCp  PCpV  2 PcCpj,Qj,  + UA 


(3-21) 


The  model  parameter  values  are  given  in  Ahlgren  and  Stevens  (1971),  and 
for  notation  consult  Table  3-1. 

The  adaptive  controllers  tested  here  employ  the  UDU  factorization  of 
a recursive  least  squares  with  variable  forgetting  factors  given  in 
Appendix  B and  with  parameters  as  in  Table  3-2.  To  reduce  numerical 
problems  in  the  estimator  the  input  and  output  variables  are  scaled  so 
that  the  components  of  x(t-k-l)  (Equation  (2-13))  do  not  differ  widely  in 
order  of  magnitude.  Thus, 

y(t)  = C(t)/Cre£  5 u(t)  = Qc(t)/Qcref  (3-22) 

where  the  reference  values  are  given  in  Table  3-1.  The  table  also 
includes  all  the  CSTC  parameters. 

Figures  3-1  to  3-5  examine  controller  performance  for  small  changes 
in  the  set  point  and  the  disturbance  Cj.  At  time  t = 450  (sampling 
intervals  of  20s)  the  set  point  was  changed  from  y^  = 0.05  to  0.10  and  at 
t = 1200  the  inlet  concentration  decreased  by  10%.  Figure  3-1  presents 
the  performance  of  the  MV  STC.  It  is  seen  that  it  is  fairly  successful 
in  following  the  set  point  and  in  rejecting  the  load  change.  However, 
the  control  variable  behavior  is  unacceptably  oscillatory.  Figure  3-2 
depicts  the  CSTC  performance  with  "caution"  term  Uj,i(t).  For  both  set 
points  the  a priori  known  Ug  is  initially  10%  below  the  correct  value 
and,  since  the  inlet  concentration  drop  is  unmeasured,  the  u_  value  is 
not  altered  at  t = 1200  resulting  in  an  increase  of  the  Ug  error  to  58%. 
It  is  seen  that  both  the  output  and  input  are  considerably  improved.  The 
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last  plot  of  Figure  3-2  is  of  h(t).  After  the  set-point  and  disturbance 

changes,  it  increases  reflecting  the  increase  in  plant/raodel  mismatch, 

and  subsequently  drops  as  the  parameter  estimates  improve.  For 

comparison  purposes  Figure  3-3  shows  the  system  response  for  u(t)  = Up. 

s 

Since  the  Ug  values  are  incorrect,  offset  results.  The  CSTC  response  for 
"caution"  part  U(,2(t)  is  given  in  Figure  3-4.  An  approximate  model  is 
first  obtained  by  estimating  parameters  while  running  the  process  around 
the  initial  steady  state  with  white  noise  excitation.  At  t = 50  the  CSTC 
starts  and  controls  the  reactor  successfully.  To  be  safe  the  filter 
constant  was  assigned  the  high  value  f = 0.999.  For  this  value  the  IMC 
response  is  extremely  sluggish  as  seen  in  Figure  3-5. 

Figures  3-6  to  3-10  show  controller  performance  for  the  large  set- 
point  change  from  0.95  to  0.10.  The  MV  STC,  as  seen  in  Figure  3-6, 
completely  fails  to  drive  the  process  to  the  new  set  point.  Instead,  the 
coolant  flowrate  is  stuck  at  the  lower  bound.  In  contrast,  the  SCTC  with 
'caution"  succeeds  (Figure  3-7),  even  though  the  a priori 

specified  Ug  if  off  by  10^.  It  is  worth  noting  that  the  reactor  has 
steady-state  multiplicity  and  for  control  u(t)  = Uj,i(t)  the  process  winds 
up  at  the  wrong  steady  state  (Figure  3-8).  The  successful  performance  of 
the  CSTC  with  Uj,2(t)  is  shown  in  Figure  3-9.  Figure  3-10  depicts  the 
sluggish  response  of  u(t)  = Uj>2(t).  Finally,  it  should  be  mentioned  that 

the  CSTC  responds  quite  well  to  step  changes  in  any  of  the  disturbances. 

For  example.  Figure  3-11  shows  the  CSTC  response  to  the  changes  (i)  20% 
drop  in  Cj  at  t = 300;  (ii)  50%  increase  in  C;^  at  t = 600;  (iii)  5%  drop 

in  Tj  (®K)  at  t = 900;  (iv)  8%  drop  in  T^,  at  t = 1200;  (v)  11%  increase 

in  Q at  t = 1500,  and  (vi)  9%  drop  in  UA  at  t = 1800. 
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Remark.  It  should  be  pointed  out  that  the  CSTC,  by  slowing  down  the 
system  and  adding  excitation,  aids  the  parameter  estimator.  As  a result 
the  model  identified  by  the  CSTC  differs  from  that  identified  by  the  MV 
STC  even  though  both  have  been  tuned  identically,  and  when  h approaches 
zero  the  CSTC  control  law  performs  considerably  better  than  the  MV  STC 
law. 
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Figure  3-1.  Dimensionless  concentration  y(t)  and  coolant 
flowrate  u(t)  when  the  reactor  is  controlled 
by  the  MV  STC. 
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3 2,  DimensionlGss  concGntration  y(t),  coolant  flowrate 

u(t)  and  weight  h(t)  when  the  reactor  is  controlled 

by  the  CSTC  with  caution  term  u (t) . 
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Figure  3-3.  Dimensionless  concentration  y(t)  and  coolant  flowrate 
u(t)  when  the  reactor  is  run  open  loop  with  u(t)  = 

Ug.  The  dotted  line  is  the  set-point. 


V, 
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Figure  3-4.  Dimensionless  concentration  y(t),  coolant  flowrate 

u(t)  and  weight  h(t)  when  the  reactor  is  controlled 

by  the  CSTC  with  caution  term  u „(t). 

c4 
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Figure  3-5.  Dimensionless  concentration  y(t)  and  coolant  flowrate 

u(t)  when  the  reactor  is  controlled  by  u (t) . 

X^C 
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Figure  3 6.  Dimensionless  concentration  y(t)  and  coolant  flowrate 
u(t)  when  the  reactor  is  controlled  by  the  MV  STC. 
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Figure  3-7.  Dimensionless  concentration  y(t),  coolant  flowrate 

u(t)  and  weight  h(t)  when  the  reactor  is  controlled 

by  the  CSTC  with  caution  term  u , (t) . 

^ cl 
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Figure  3-8.  Dimensionless  concentration  y(t)  and  coolant  flowrate 
u(t)  when  the  reactor  is  run  open  loop  with  u(t)  = 

u . 

s 
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Figure  3-9.  Dimensionless  concentration  y(t),  coolant  flowrate 

u(t)  and  weight  h(t)  when  the  reactor  is  controlled 

by  the  CSTC  with  caution  term  u o(t). 

c2 
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Figure  3-10.  Dimensionless  concentration  y(t),  coolant  flowrate 

u(t)  when  the  reactor  is  controlled  by  u ..„(t). 

IMG 
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Figure  3-11.  Dimensionless  concentration  y(t),  coolant  flowrate 

u(t)  and  weight  h(t)  when  the  reactor  is  controlled 

by  the  CSTC  with  caution  term  u , (t) . 

ci 
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Table  3-1 

Notation  for  Example 

A 

= heat  exchange  area 

C 

= concentration 

Ci 

= inlet  concentration 

= reactant  specific  heat  capacity 

Cpc 

= coolant  specific  heat  capacity 

^ref 

= reference  concentration 

E 

= activation  energy 

AH 

= enthalpy  change  of  reaction 

K 

= reaction  rate  preexponential  factor 

Q 

= inlet  flowrate 

Qc  = 

= coolant  flowrate 

Qcref  = 

= reference  coolant  flowrate 

R 

= gas  constant 

T 

= reactor  temperature 

Tc  = 

= coolant  temperature 

Ti  = 

= inlet  temperature 

U 

= heat  transfer  coefficient 

V 

= reactor  volume 

Greek  Letters 

P 

= reactant  density 

Pc 

= coolant  density 

44 


Table  3-2 
Parameter  Values 

Estimator  Parameters 
Y = 1 X 10"^ 
a = 1 X 10-5 

Xjjin  =*0.1 

Scaling  Parameters 

Cref  =0.5  Ib-moles/ft^  = 8.01  kg-moles/m^ 
Qcref  = 0-2  ft^/s  = 5.664  x lO'^  m3/s 

CSTC  Parameters 
8 = 0.20 
p = 0.95 

E ^ 0.01 

Ug  (when  = 0.05)  = 0.05  (correct  value  = 

Ug  (when  yg  = 0.10)  = 0.9  (correct  value  = 

Ug  (when  yg  = 0.95)  = 1.4  (correct  value  * 

f = 0.999 


0.573) 

1.02) 

1.57) 


CHAPTER  IV 

A MIMO  CAUTIOUS  SELF-TUNING  CONTROLLER 


Introduction 


In  this  chapter  the  Cautious  Self-Tuning  Controller  is  extended  for 
multi  input-multi  output  (MIMO)  systems  with  multiple  time  delays.  MIMO 
quadratic  STCs  have  been  developed  first  by  Borisson  (1979),  Keviczky  and 
Kumar  (1982),  and  Koivo  (1980)  assuming  the  same  time  delay  for  each 
input-output  pair.  Subsequently  Tsiligiannis  and  Svoronos  (in  press; 
1986b)  presented  quadratic  STCs  applicable  to  systems  with  multiple 
delays  with  non-trivial  cross-couplings.  All  these  controllers  are  based 
on  constant  weights  penalizing  the  control  variable  with  the  associated 
problems  discussed  in  section  3.1 

Here  the  control  weights  are  tuned  on-line  so  as  to  maintain  the 
input  and  output  variables  bounded  despite  any  unmodeled  dynamics, 
nonlinearities  and/or  estimation  error. 

The  design  and  implementation  of  the  controller  maintains  the 
essential  simplicity  and  small  computational  requirements  of  the  STR. 

Model 


A discrete  time  input-output  representation  of  linear  multivariable 
systems  has  the  form 


A'(q-l)Y(t+l)  = B'(q-l)U(t)  + S' 


(4-1) 
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where  Y(t),  U(t)  are  the  1-dimensional  input  and  output  vectors,  is 

t 

the  backward  shift  operator,  and  A'(q~^),  B'(q“^)  are  polynomial  matrices 
in  The  1-dimensional  vector  S'  represents  deterministic 

disturbances  which  are  either  slowly  varying  or  experiencing  step  changes 
and  can  be  identified  by  a suitable  estimator. 

In  particular  it  can  be  assumed  without  loss  of  generality  that 

A'(q-l)  = diag  [ai(q-l)] 

with 

= 1 + q~l  + ...  + a^^j^  a"“i 

and 

-di-4 

(B'(q-l))ij  = q b'ij(l-l) 

with 

b'ijCq'^)  - b'jjg  . b'iji  q-q  . ...  + 


and  djj  is  the  time-delay  between  the  i^^  output  and  the  input. 

In  designing  one-step-ahead  controllers  the  predictor  form  of  (4-1) 
is  needed.  This  step  is  not  trivial  in  the  presence  of  multiple  delays 
and  has  not  been  resolved  yet  for  the  general  case.  However,  there  exist 
methods  (requiring  apriori  knowledge  for  the  delay  structure  of  B'(q~^)) 
which  recast  (4-1)  into 


A(q-l)  W(t+d+l)  = B(q-l)  V(t)  + S 


(4-2) 


a 
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with 


A(q  1) 


n+1 
Z Aj 
i=l 


Aq  = I 


(4-3) 


B(q-l) 


m 


Z 

i=l 


det  (Bq)  # 0 


(4-4) 


W(t)  = q-k  K(q)  Y(t) 


(4-5) 


V(t)  = M(q-l)  U(t)  (4-6) 

and 

d = k + y 

where  K(q),  M(q“^)  are  polynomial  matrices  in  q and  q“^,  respectively, 
and  k,  y are  the  maximum  degrees  in  any  element  of  K(q),  M(q”^), 
respectively.  The  vector  W(t)  is  known  at  time  t while  U(t)  is 

determined  from  the  present  and  previous  V(t).  The  matrices  K(q),  M(q~^) 
are  known  and  depend  on  the  available  information.  It  is  required  that 
[q^  M(q~^)]“^  be  a stable  operator. 

For  example,  if  the  left  interactor  matrix  L(q)  of  model  (4-1)  is 
known  (Goodwin  and  Sin,  1984,  p.  132),  then 

M(q-l)  = I , y = 0 


K(q)  = L(q) 
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If  the  right  interactor  matrix  R(q)  is  known  (Tsiligiannis  and  Svoronos, 
1986b),  then 

K(q)  = I k = 0 
M(q-l)  = R(q-l) 

Both  of  the  above  methods  require  the  knowledge  of  the  interactors  L(q) 
or  R(q)  which  can  be  restrictive  in  many  cases.  A method  requiring  the 
knowledge  of  only  the  time  delays  dj^j  has  been  presented  by  Tsiligiannis 
and  Svoronos  (in  press).  According  to  this  method 

K(q)  = diag  (q^i)  k = max  (kj) 

M(q)  = diag  (q^^i)  y = max  (y^) 

and  the  k^,  yj  are  found  from  the  d^j's  by  solving  an  integer  programming 
problem.  The  method  can  treat  large  classes  of  systems  with  nontrivial 
cross  couplings,  but  not  the  general  case.  An  alternative  method  for  a 

similar  class  of  systems  was  proposed  by  Singh  and  Narendra  (1984). 

The  aim  of  all  these  methods  is  to  obtain  a parameterization  model 
(4-2)  of  (4-1)  with  det(BQ)  ^ 0 and  [q^  M(q~^)]“^  stable.  Then  the 

predictor  form  is  obtained  from  (4-2)  using  the  identity 

I = F(q-l)  A(q-l)  + q"d-l  G(q-l) 


(4-7) 
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where 


F(q  ^)  = I + q~l  + ...  + Fj  q''^ 


(4-8) 


G(q  = Gq  + q ^ + ...  + Gj^  q 


(4-9) 


and 


W(t+d+l)  = C(q-l)  W(t)  + D(q-l)  V(t)  + r 


(4-10) 


where 


C(q-^)  = G(q-l) 


D(q-l)  = F(q-l)  B(q~l) 


and 


Dq  = Bq 


Equation  (4-10)  is  equivalently  written  in  vector  form  as 


W(t+d+l)  = 0 X(t) 


= 01  Xi(t)  + Bq  V(t) 


(4-11) 


where  0 is  the  model  parameter  matrix, 


X'^(t)  = [wT(t)  wT(t_i) 


• * * 


wT(t-n)  V^(t)  vT(t-l)  ...  vT(t-m-d)l] 
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and 


XiT(t)  = [wT(t)  ...  wT(t-n)  vT(t-l)  ...  vT(t-m-d)l] 

The  unknown  model  parameters  0 are  estimated  on-line  from  (4-11)  via 
a recursive  estimator.  In  particular,  we  consider  here  a multivariable 
version  of  the  least-squares  estimator  presented  in  Appendix  B. 

Define  the  parameter  error  matrix 

0(t)  = e - 0(t) 

Then,  the  output  prediction  at  time  t + d + 1 given  information  up  to 
time  t is 

W(t+d+l|t)  = 0(t)  X(t)  (4-12) 

= 0l(t)  Xi(t)  + Bo(t)  V(t) 

Also,  the  output  prediction  at  time  t given  parameter  estimates  at  time  t 
- 1 is 

W(t|t-1)  = 0(t-l)  X(t-d-l)  (4-13) 

and  the  output  prediction  error 


e(t)  = W(t)  - W(t|t-1) 


(4-14) 
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The  CSTC  requires  that  BQ(t)  is  non-singular.  The  time  instants  at 
which  BQ(t)  becomes  singular  form  a set  of  measure  zero.  But  even  for 
those  instants,  it  is  shown  in  Goodwin  and  Sin  (1984,  p.  206)  that  a 
simple  algorithm  modification  removes  the  problem. 

Multivariable  Cautious  Self-Tuning  Controller 

The  Cautious  Self-Tuning  Controller  (CSTC)  is  based  on  the  following 
single  stage  cost  function: 

J = |W(t+d+l|t)  - Wj.|2  + [V(t)  - Q(t)  [V(t)  - V^]  (4-15) 

where  Q(t)  is  a positive  semidefinite  matrix,  Wj.  is  a filtered  reference 
signal  given  by 

Vj.  = K(q)  Yj- 


Also 


Vr  = M(l)  Ur 

where  Uj.  is  the  steady-state  control  vector  corresponding  to  Yj.  (or  an 
approximation  to  it).  Equation  (4-15)  differs  from  the  cost  function 
introduced  in  Clarke  and  Gawthorp  (1975),  in  that  Q(t)  is  allowed  to  be 
time-varying  and  is  tuned  on-line. 

Upon  minimization  with  respect  to  V(t),  (4-15)  results  in  the 

following  expression  for  the  control  law 


[0l(t)Xi(t)-Wr]  + [Bo(t)+Bo"T(t)Q(t)]V(t)  = Bo-T(t)Q(t)Vj. 


(4-16) 
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where  the  superscript  -T  denotes  transposed  inverse.  If  Q(t)  =0  at  time 
t,  the  one-step-ahead  dead-beat  control  policy  is  obtained 

Vdb(0  = BQ-^(t)  [Wj.  - 0i(t)  Xi(t)]  (4-17) 

If  Q(t)  » 0 V t,  then  (4-17)  corresponds  to  the  optimal  dead-beat  control 
law  (minimum  variance  in  the  stochastic  case). 

Using  (4-16)  and  (4-17)  we  can  express  the  cautious  control  law  V(t) 
as  a linear  combination  of  the  constant  term  Vj.  and  the  dead-beat  control 
^db 


V(t)  = H(t)  Vr  + [I  - H(t)]  Vdb(t)  (4-18) 

where 

A A 

H(T)  = [BoT(t)  Bo(t)  + Q(t)]-1  Q(t)  (4-19) 

'^db  term  represents  a "fast"  performing  control  law  which  if  based  on 
the  true  process  model  achieves  W(t+d+l)  = W^..  But  if  it  is  based  on  a 

poor  model  it  might  lead  to  poor  performance.  On  the  other  hand,  the 
term  Vj.  is  model  Independent  and  drives  the  system  outputs  close  to  Yj. 
with  open-loop  dynamics.  It  represents  a "worst  case"  robust  control 
law.  The  positive  semi-definite  matrix  H(t)  weighs  the  contributions  of 
the  "fast"  V(jb  and  the  robust  Vj.  terms  in  (4-18). 

In  what  follows  we  choose  H(t)  to  be  a diagonal  matrix;  i.e. 


H(t)  s diag  [hi(t),  h2(t),  ...,  hi(t)] 


(4-20) 
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with 

0 < hi(t)  <1  i = 0,  1 

Note  that  since  (4-19)  gives 

* A 

Q(t)  = [I-H(t)]-1  Bo'^(t)  Bo(t)  H(t) 

Q(t)  is  positive  semidefinite  for  the  above  choise  of  H(t). 

The  structural  simplicity  of  (4-18)  leads  to  an  easier  and  more 
transparent  way  of  tuning  the  algorithm  through  H(t)  instead  of  Q(t).  In 
the  case  of  large  plant/model  mismatch  a large  value  of  hj(t)  close  to 
one  is  appropriate.  This  choice  would  make  the  robust  term  dominant  and 
weigh  out  the  unreliable  V^jj,  contribution.  When  the  estimated  parameter 
matrix  0(t)  and  (4-12)  provide  an  accurate  description  of  the  process, 
hj(t)  should  be  taken  close  to  zero  making  the  dominant  term. 

A method  for  relating  hj(t)  to  the  plant/model  mismatch  is  given 
next.  The  objective  is  to  obtain  a control  law  which  is  bounded  in  spite 
of  modeling  inaccuracy  and  estimation  errors. 

From  (4-18)  we  obtain 

V(t)  - Vr  = (I  - H(t))  (Vdb(t)  - Vr)  (4-21) 

Define 

V(t)  = V(t)  - Vr  = [Vi(t),  ...,  Vi(t)]T 

and 


Vdb(0  = Vdb(t)  - Vr  = [Vdbl(t) Vdbi(t)]T 
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Then  from  (4-21) 

Vi(t)  = (1  - hi(t))  Vdbi(0  i = 1.  1 

or 

|Vi(t)|  = (1  - hi(t)  |Vdbi(t)|  i = 1,  1 (4-22) 

The  following  bound  is  imposed  on  |Vi(t)| 

&i 

|Vi(t)  < i = 1,  1 (4-23) 

h(t) 

where  h(t)  is  a measure  of  the  plant/model  mismatch. 

A large  Vi(t)  restricts  the  control  V^(t)  close  to  V^i  and 
effectively  weighs  out  erroneous  contributions  from  Vdjji(t)*  As  the 
model  improves,  h(t)  decreases  allowing  larger  control  amplitudes  and  the 
control  law  achieves  faster  performance. 

Equation  (4-23)  is  satisfied  if 

n(t) 

hi(t)  = (4-24) 

^i 

+ h(t) 

|Vdbi(t)l 

which  is  functionally  similar  to  (3-16)  and  gives  hj(t)  = 0 only  for  X\  = 

0. 

The  same  measure  of  plant/model  mismatch  as  the  one  introduced  in 
Chapter  III  (3-15)  is  used  here.  It  is  related  to  the  prediction  error 
by 
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n(t)  = n(t-l)  + (l-X)  |e(t)|  ; 0 < X < 1 (4-25) 

Note  that  the  method  presented  in  Chapter  III  for  tuning  h(t)  can  be 
easily  extended  to  multivariable  systems.  This  method  is  based  on  the 
minimization  of  control  law  sensitivity  to  the  prediction  error.  In  this 
chapter  H(t)  tuning  is  based  on  a different  method.  The  objective  is  to 
keep  the  control  bounded  in  case  of  large  errors.  Both  methods  express 
hj^(t)  as  increasing  function  of  the  plant/model  mismatch.  It  should  be 
pointed  out  here  that  other  objectives  may  be  used  in  tuning  H(t)  as  well 
as  different  measures  of  the  plant/model  mismatch,  e.g.  the  aposteriori 
prediction  error  or  the  estimator  quantity  |e(t+l)|^  / (X(t+1)  + w(t)]. 

Stability  and  Robustness  of  CSTC 

The  CSTC  has  been  designed  with  non-ideal  applications  in  mind.  It 
will  be  shown  that  under  assumptions  satisfied  by  many  nonlinear  systems 
the  input  and  output  variables  remain  bounded. 

Statement  4.1 


Assume 

1.  that  le(t)|  cannot  converge  to  zero  unless  the  output  is  bounded  or 
unless  the  input  is  bounded, 

2.  that  the  true  process  model  is  bounded  input-bounded  output  stable. 


i.e. 
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I |y(t)|  loo  < Ki  + K2  1 |u(t)|  |„  (4-26) 

and  bounded  output  bounded  input  stable,  i.e. 

1 |u(t)|  U < Ki  + K2  I |y(t)| |„  (4-27) 

where  ||•(t)||o^,  denotes  the  1„  norm  truncated  at  time  t,  i.e. 

I I *(t)  I loo  = max  I -(T)|  ; 

0<T<t 

then,  if  the  process  is  controlled  by  the  CSTC  the  input  and  output 
variables  remain  bounded. 

Proof.  Assume  that  the  output  is  unbounded.  Since  |e(t)l  cannot 
converge  to  zero  (assumption  1)  it  follows  from  (4-25)  that  h(t)  is 
bounded  away  from  zero.  Inequality  (4-23)  then  implies  that  v(t)  is 
bounded  and  since  M(q~^)  is  stable  it  follows  from  (4-6)  that  u(t)  is 
bounded.  Then  it  follows  from  (4-26)  that  y(t)  is  bounded  thus 
contradicting  the  initial  assumption.  Therefore,  y(t)  is  bounded  and 
from  (4-27)  u(t)  is  also  bounded. 

The  same  result  is  obtained  in  analogous  manner  if  we  start  with  the 
assumption  that  the  input  is  bounded. 

Remark.  For  linear  systems  (4-26)  means  that  the  system  is  open- 
loop  stable  and  (4-27)  that  is  minimum  phase. 


CHAPTER  V 

MODEL  DEPENDENT  CONTROL  ANALYSIS 


Introduction 


Controller  design  methods  for  linear  systems  can  be  distinguished  in 
two  general  categories.  Fixed  structure  methods  where  the  controller 
structure  is  first  selected  and  then  any  free  parameters  are  tuned  based 
on  process  information.  Advantages  of  the  method  are  its  simplicity  and 
that  it  does  not  require  knowledge  of  a detailed  model.  The  major 
disadvantage  is  poor  closed-loop  performance  in  many  cases.  The  best 
known  controller  in  this  category  is  the  PID  with  three  tuning 
parameters.  The  second  category  consists  of  methods  which  require  the 
knowledge  of  a detailed  process  model  in  order  to  design  the  controller. 
Here  one  first  specifies  the  closed-loop  performance,  and  then  the 
controller  structure  and  parameters  follow  from  the  design  method  and  the 
process  model.  This  category  includes  optimal  control,  state  feedback, 
pole/zero  placement  methods  and  numerous  others. 

An  interesting  method  of  designing  model  dependent  controllers  has 
been  developed  recently  and  is  based  on  model  inversion.  The  general 
approach  includes  Internal  Model  Control  (Garcia  and  Morari,  1982,  1985a, 
1985b;  Morari,  1983;  Morari  et  al.,  1984;  Economou  et  al.,  1984), 
Inferential  Control  (Brosilow  and  Tong,  1978;  Brosilow,  1979;  Chen  and 
Brosilow,  1984),  Q-parametrization  (Zames,  1981;  Desoer  and  Chen,  1981). 
All  these  methods  are  based  on  the  same  design  philosophy  with 
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differences  on  the  final  control  realization.  The  design  procedure 
consists  of  obtaining  an  approximate  stable  model  inverse  and  then  taking 
the  controller  as  the  product  of  this  inverse  and  a filter  which  is 
designed  to  achieve  the  desired  performance  and  robustness.  This  simple 
and  elegant  procedure  gives  excellent  results  with  respect  to  set-point 
tracking  but  might  not  perform  well  in  rejecting  disturbances  especially 
if  the  open-loop  dynamics  are  slow.  Also,  the  method  is  applicable  only 
to  open-loop  stable  systems. 

The  Model  Dependent  Controller  (MDC)  introduced  recently  by  Svoronos 
(1986)  handles  effectively  both  set-point  tracking  and  disturbance 
rejection,  and  is  applicable  to  both  open-loop  stable  and  unstable 
systems.  The  method  first  transforms  the  input  so  that  the  system  is 
stable  with  respect  to  the  transformed  input  and  with  disturbance  poles 
at  more  favorable  locations.  Then  the  IMC  design  methodology  is  used  for 
set-point  tracking.  The  algorithm  resolves  the  robustness  versus 
performance  issue  in  a simple  and  straightforward  way  through  two  tuning 
parameters  which  determine  the  location  of  the  closed-loop  poles. 

Some  modifications  of  the  MDC  algorithm  are  presented  in  this 
chapter  which  improve  the  closed-loop  performance.  Also,  the  MDC 
robustness  is  analyzed  and  it  is  proved  that  the  algorithm  is  robust 
under  model  uncertainty.  Only  SISO  systems  are  treated  in  this  chapter. 

The  MDC  Method 


Consider  the  discrete  time  linear  model 
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A(z)  y(z)  = B(z)  u(z)  + C(z)  d(z)  (5-1) 

where  7(z),  Q(z),  d(z)  are  the  z-transforms  of  the  output  y(t),  the 
control  u(t)  and  the  disturbance  d(t),  respectively,  and  A(z),  B(z),  C(z) 
are  polynomials  in  the  complex  variable  z“^.  Model  (5-1)  can  be 
expressed  equivalently  in  transfer  function  form  as 


y(z)  = G(z)  u(z)  + G(j|(z)  d(z) 

where 


(5-2) 


B(z) 

G(z)  = 

A(z) 

C(z) 

Gd(z)  

A(z) 

As  mentioned  earlier,  inversion  based  methods,  e.g.  IMG,  require  that 
G(z)  is  stable.  No  such  assumption  is  made  here.  Instead  the  system  is 
first  "stabilized"  by  feedback  and  then  the  model  inversion  methodology 
is  applied. 

This  is  achieved  by  defining  a generalized  input  v as  function  of 
the  control  u and  the  output  y,  this  will  be  selected  so  that  the  poles 
of  the  transfer  function  between  y and  v are  in  desired  locations. 
Subsequently  the  generalized  input  will  be  designed  using  the  IMG 
methodology. 
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Stabilization 


The  polynomial  B(z)  is  factored  as 
B(z)  = B^(z)  B_(z) 


where  B^(z)  contains 

the  non-invertible 

elements 

of 

B(z), 

i.e.  the  time 

delay  and  all  zeroes 

of  B(z)  on  or 

outside 

the 

unit 

circle.  The 

generalized  input  is  then  defined  from 


v(z)  =.  Q(z)  B_(z)  u(z)  + P(z)  y(z)  (5-3) 

where  Q(z),  P(z)  are  polynomials  that  will  be  specified  later.  In  the 
following,  the  argument  z is  dropped  for  brevity.  It  may  appear  however 
when  needed  to  enhance  clarity.  Substitution  of  (5-3)  in  (5-1)  results 
to 


Ty  = B^v  + QCd  (5-4) 

where 

T = AQ  + B^P  (5_5) 

The  polynomial  T is  a design  quantity  whose  zeroes  are  the  poles  of 
the  transfer  function  between  y and  V. 

The  polynomials  Q and  P are  found  as  the  solution  of  the  Bezoutian 
equation  (5-5).  This  is  solvable  provided  that  B^  and  A are  coprime  (or 
the  system  is  stabilizable) . 
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Given  P and  Q,  (5-3)  represents  a linear  discrete  control  law  where 
7 plays  the  role  of  a reference  signal.  Next,  7 will  be  formulated  as  a 
function  of  the  known  reference  signal,  i.e.  the  output  set-point  7gp. 

Generalized  Input  Design  via  IMG 

If  we  consider  (5-4)  as  the  process  model,  the  IMG  law  is  given  by 
the  methods  described  in  Appendix  A as 


7 


TF 

(1-B+F) 


l^sp  - 71 


(5-6) 


where  F is  the  filter  transfer  function  which  without  loss  of  generality 
can  be  expressed  as 


F(z)  = 


Fn<z) 

Fd(z) 


(5-7) 


The  polynomials  Fjj(z),  Fp(z)  will  be  specified  in  the  following  section. 


MDC  Control  Law 


The  MDC  control  law  is  obtained  combining  (5-6)  and  (5-3)  as 
H a + K7  = Fn  T 7gp  (5-8) 


where 
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H = QB_  (Fd  - 
K = QAFn  + PFj3 

Closed-Loop  Equations 

Using  (5-8)  and  (5-1)  we  obtain  the  closed-loop  equations 


■ y 

■ B ■ 

■ H ■ 

= FfjT 

ysp  + c 

. -K  . 

. u , 

. A . 

where 


Tc  * AH  + BK  = B.FqT  (5-10) 

It  is  seen  from  (5-9)  and  (5-10)  that  the  closed-loop  system  is  stable. 
Cancelling  known  and  stable  poles  and  zeroes  in  (5-9)  we  obtain 


- - 

y = y 


sp 


(FD“B+Fjj)QC  _ 


(5-11) 


It  is  seen  that  the  closed-loop  disturbance  dynamics  include  the  IMC 
filter  poles.  If  it  is  desired  that  the  tracking  and  disturbance 
rejection  dynamics  be  independent,  Fp  is  cancelled  by  taking 


Q = Ql  Fd 


(5-12) 


and  (5-11)  becomes 
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B+F(j  _ (Fj3-B^F(q)QiC  _ 

7sp  + d 

D 


(5-13) 


It  is  clear  from  (5-13)  that  the  closed-loop  performance  for  set-point 
tracking  depends  on  Fq  and  that  for  disturbance  rejection  only  on  T. 
Both  Fp  and  T are  designed  polynomials.  As  in  IMC,  for  asymptotically 
constant  disburbances  MDC  eliminates  steady-state  offset  if 


Fp(l)  - B^(l)  Fn(1)  = 0 


(5-14) 


or 


B+(l)  Fn(1) 

= 1 (5-15) 

Fd(1) 

as  it  can  be  easily  verified  from  (5-13). 

Closed-Loop  Polynomial  Selection 

The  transient  performance  of  the  closed-loop  system  depends  on  the 
location  of  the  closed-loop  poles.  As  shown  later  in  section  5.5  the  MDC 
robustness  also  depends  on  the  pole  location.  In  this  section,  the 
closed-loop  pole  selection  is  discussed. 

Set-Point  Tracking  Poles 

Robustness  and  performance  analysis  for  IMC  (Appendix  A)  results  in 
the  following  selection  for  the  tracking  poles: 
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Fd(z)  = B^(z)  (1-fz-l)  0 < f < 1 (5-16) 

with 

m 

B+(z)  . n (-Zi+  + z~h  (5-17) 

i=l 

where  zj+  (i  = l,...,m)  are  the  zeroes  of  B^(z).  Note  that  B^.(z)  and  B(z) 
form  an  "allpass";  i.e. 


B+(z) 

B+(z) 


1 for  z =.  e^“ 


1 

and  the  zeroes  (i  = 1,  . . . , m)  of  B.(z)  are  all  inside  the  unit 

Z-  + 

circle. 


In  view  of  (5-15),  the  steady-state  offset  is  eliminated  if 


Fn  = (5-18) 

Using  (5-16),  (5-17),  and  (5-18)  the  tracking  properties  are 

described  by 

B^(z)  1-f  _ 

y(2)  = ysp(z) 

B+(z)  1-fz-l 


which  gives 
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1-f 


Disturbance  Rejection  Poles 

Disturbance  rejection  depends  on  the  zeroes  of  T(z)  which  in  view  of 
(5-5)  and  (5-16)  becomes 


Aj^(z)  = A(z)  Fj3  = ao  II  (l-pjz*^) 

and  p^  (i  = 1,  n^)  are  the  zeroes  of  Ai(z).  These  zeroes  include 

the  model  open-loop  poles,  the  zeroes  l/z+  (j,  1,  m)  of  B^(z) 

and  the  filter  pole  of  f. 

Then,  T(z)  is  chosen  as 
"1  ^i 

T(z;r)  = ao  n (1-r z“^)  0 < r < 1 (5-20) 

i=l 


T = Ai  Qi  + P 


(5-19) 


where 


max 


where 
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for  some  small  £ > 0,  and  with  c * 0 for  open-loop  stable  systems. 
Alternatively  T(z;r)  can  be  obtained  without  having  to  solve  for  the 
open-loop  poles  from 


T(z;r)  = Ai 


Pmax 


z 


(5-21) 


We  see  from  (5-20)  that  the  closed-loop  poles  lie  inside  concentric 
circles  of  radii 


R = 


^ ^max 


0 < r < 1 


where  R = R^^x  is  a circle  containing  all  the  open-loop  model  and  filter 
poles  scaled  by  Pmax*  scaling  ensures  that  the  zeroes  of  T(z)  are 
inside  the  unit  circle  when  the  system  is  open-loop  unstable.  The 
concentric  circles  of  radius  R represent  loci  of  constant  settling  times. 
It  is  easy  to  show  that  for  r = 0 MDC  is  equivalent  to  the  dead-beat 
controller  and  for  r = 1 to  IMC  (for  open-loop  stable  systems). 

MDC  Algorithm 


Collecting  all  the  pieces  together,  the  MDC  algorithm  is  summarized 
as  follows: 

(i)  Choose  parameters  f and  r so  the  desired  performance  and 
robustness  specifications  are  met. 

(ii)  Choose  the  IMC  filter  as 


Fd(z) 
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^max 


Fi3(z)  = B^(z)  (1-fz-l) 

Fn  = 1-f 

(iii)  Find  T(z)  from 

r rz  ■ 

T(r,z)  = 
where 
Ai(z)  = A(z)  Fd(z) 
and  solve  for  and  P from 
T(z)  = Ai(z)  Qi(z)  + B^(z)  P 

This  equation  has  an  infinite  number  of  solutions  and  the 
minimal  order  one  is  obtained  by  setting  the  degrees  of  P(z) 
and  Q(z)  to 
deg(P)  . deg(Ai)-l 
deg(Qi)  = deg(B^)-l 
(iv)  Obtain  the  MDC  law  from 


FdQiB_(Fd-B^Fi^)u  + Fj3(QiAFf,+P)  y = FfjTygp 
It  would  be  desirable  in  many  cases  that  MDC  involves  only  one 
tuning  parameter.  This  can  be  achieved  by  taking 
f = r 


and 

Q = Ql 

i.e.  the  filter  pole  z = f is  not  cancelled  in  the  second  term  of  the  RHS 
of  (5-11). 

This  makes  MDC  a very  practical  algorithm  with  only  one  parameter  to 


tune. 
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Robustness  of  MDC  Law 


In  many  cases  the  available  model  is  only  an  approximate  description 
of  the  process  dynamics.  Control  laws  based  on  "nominal"  models  may  not 
meet  the  design  specifications  and  in  some  cases  they  might  render  the 
closed-loop  system  unstable. 

Consider  a linear  process  described  by 


and  the  nominal  model  (5-1)  approximating  (5-22) 


(5-22) 


Ay  = Bu  + Cd 


Bq  B 

Also  let  Gq  = — , G = _ represent  the  true  and  nominal  transfer  functions 

Aq  a 

respectively,  and  define  the  additive  (absolute)  model  uncertainty  by 


AG  = Gq— G 


and  the  multiplicative  (relative)  by 


_ Gq-G 
AG  = 


G 
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We  shall  find  conditions  involving  the  model  uncertainty  and  the 
location  of  the  closed-loop  poles  so  that  the  MDC  closed-loop  system  is 
robustly  stable. 

Theorem  5.1 

Let  p((o)  be  an  upper  bound  on  |AG(z)|,  i.e. 

|■Ae(eJ“)|  < -p(«)  < ® 


Then  the  closed-loop  system  under  MDC  is  stable  if  the  following  are 
true; 


(i)  A(z)  and  Aq(z)  have  the  same  number  of  zeroes  outside  the 
unit  circle 


(ii) 


|g(eJ “)  I 


1-k 


< 

p(w) 


0 < k < 1 


where 


P(z)  B^(z) 

g(z)  = 

T(z) 

k 

< 

p(w) 

T(l)  Bod) 

b.  > 0 

Tod)  B^d) 


(iii)  a.  |l-g(eJ“) 


1-f 

l-fe-j“ 


where 

Tq  = AqQB_  + BqP 


(5-23) 
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Proof.  Theorem  5.2  will  be  proved  in  two  parts.  First,  it  will  be 
shown  that  conditions  (i)  and  (ii)  result  to  a stable  input-output 
equation  between  y and  7,  and  then  IMG  robustness  results  and  condition 
(iii)  are  utilized  to  show  overall  stability.  From  the  definition  of  the 
generalized  input  (5-3)  and  the  true  model  (5-22)  we  obtain  the  closed- 
loop  equations  between  y and  7 and  Q and  7 

Tgy  - Bqv  + QB_Cod  (5-24) 

Tqu  = Aodv  - PCQd  (5-25) 

where  Tq  is  the  actual  closed-loop  polynomial  and  is  given  by  (5-23). 
Recall  that  P,  Q satisfy 

T = A Q + P (5-26) 

and  TB_  is  the  "nominal"  closed-loop  polynomial. 

From  (5-25)  and  (5-26)  we  obtain,  after  eliminating  QB_ 


A To  PB^  _ 

= 1 + AG  (5-27) 

TB_  Aq  T 

Condition  (ii)  gives 


_ 

PB^ 

AG 

< 

T 

T 

p(«)  < 1-k 


for  z = ej“ 
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which  implies  that  the  frequency  response  of  AG  does  not  encircle  the 

T 


ATq 

point  (-1,  jq).  Then,  it  follows  from  the  Nyquist  criterion  that  

AqTB. 

has  an  equal  number  of  poles  and  zeroes  outside  the  unit  circle.  The 
number  of  poles  outside  the  unit  circle  are  the  zeroes  of  Aq  which  from 
condition  (i)  are  equal  to  the  zeroes  of  A outside  the  unit  circle.  This 
implies  that  ATq  can  have  no  other  zeroes  outside  the  unit  circle  except 
those  of  A.  In  other  words  Tq  has  no  zeroes  outside  |z|  = 1. 

For  the  next  step  consider  the  actual  system 


Toy  * Bqv  + QB_CQd 
the  nominal  model 


(5-28) 


Ty  = B^v  + QCd 


and  the  IMC  law 


V 


TF 

(1-B+F) 


[ysp-y] 


Define  the  transfer  functions 


To 

B^  B 
T TB 


(5-29) 


M 
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and  the  modeling  error 
_ Mq-M 

^ = (5-30) 

M 

To  invoke  the  IMG  robustness  analysis  we  have  to  know  bounds  for  In 

the  following  is  related  to  the  known  p(w). 

Using  (5-26)-(5-30)  we  can  show  that 


_ AG 

AM  = (1-g)  

1+(PB^AG)/T 


or 


|AM(z)|  < |l-g(z)| 


p(w) 


at 


= ej 


(0 


P(z)B^(z)  _ 

1+  AG(z) 

T(z) 


(5-31) 


Condition  (ii)  implies  that 


P(z)B^(z)  _ 

1 + AG(z) 

T(z) 


> k 


at  z = ej“ 


and  substitution  of  the  above  to  (5-31)  gives 

|^(z)|  < g((o)  at  z = ej“  (5-32) 

where 

1 

s(w)  = _ |l-g(ej“)|  p(w)  (5-33) 

k 


Now,  note  that  both  Mq  and  M are  stable  transfer  functions.  Then  as 
shown  in  Appendix  A,  the  IMG  law  for  the  system  (5-28)  is  robustly  stable 
if  M(l)  Mq(1)  > 0 and 
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1-f  1 

< 

S(«) 

which  are  both  true  in  view  of  (5-33)  and  condition  (iii). 

Then,  the  closed-loop  system  is  stable  and  y,  v are  bounded.  This 
in  view  of  (5-24)  and  (5-25)  implies  that  the  overall  closed-loop  system 
is  stable. 

Remark  5.1 


Condition  (iii.b)  can  be  substibuted  by 

G(l)  / God)  > 0 (5-34) 

i.e.  the  condition  for  robustness  of  IMC  for  the  system  (5-22)  (see 
Theorem  A.l). 


Proof.  From  the  bound  on  |AG|  and  condition  (ii)  of  Theorem  5.1  we 

have 


_ 

AG  < 1 

T z=l 


which  if  used  in  (5-27)  gives 


A(l)  Tod) 

> 0 

Aod)  T(1)B_(1) 


Multiplying  the  above  by  (5-34)  we  obtain  condition  (iii.b). 
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To  complete  the  robustness  discussion  we  show  that  for  open  loop 
stable  systems  there  exist  families  of  polynomials  T(z;r)  and  of  filters 
F(f;z)  that  satisfy  conditions  (ii)  and  (iii)  of  Theorem  5.1  for  all 
finite  p(«).  To  do  so  we  need  some  properties  of  the  MDC  pole  placement 
algorithm,  which  are  presented  in  Appendix  C.  It  is  shown  there  that 


P(z;r)  = 


1 - 


P(z;r) 


^max'' 

where  P(z;r)  is  a polynomial  in  z~^ 
Theorem  5.2 


and  r. 


(5-35) 


If  the  system  and  the  nominal  system  model  satisfy  the  following 
conditions: 

1.  both  system  and  model  are  stable 

2.  the  model  uncertainty  is  bounded,  i.e. 

p((o)  < M 

3.  the  model  steady-state  gain  has  the  correct  sign,  i.e. 

G(l)Go(l)  > 0 

then  the  MDC  law  is  robustly  stable  in  the  sense  that  there  exists 

^min  such  that  V r ^ ^ (^min^f^^)  <^he  closed-loop 

system  is  stable. 

Proof.  To  prove  the  theorem,  we  must  first  show  that  there  exists 
^min  such  that  V r (rmiyj<r<l)  the  condition  (ii)  of  Theorem  5.1  is 


satisfied. 
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To  show  the  above,  it  suffices  to  prove  that  there  exists  Cniin  such 

that 


<j>(o),r) 


|T(r,e^“)|2 

I B^(ej«)|2 


P^(w)  . 

^ |P(r,eJ“)|2  > 0 

(l-k)2 


(5-36) 


for  every  r (r„,in<r<l). 

From  (5-35)  and  the  fact  that  the  model  is  stable  (P^ax  = 


|P(r,eJ“)|  = (1-r)  |P(r,ej“) 


and  using  the  above  in  (5-36),  we  obtain 


|T(r,eJ“)|2  (l-r)2  , _ . ^ 

•♦•(w,r)  = , - p2(o))  |p(r,eJ“)|2 

I B^(eJ«)|2  (i_k)2 


Now,  r)  is  for  every  » a polynomial  in  r satisfying 


> 0 


since  by  condition  (2)  p(«)  < M. 

Define  r*(w)  as  the  maximum  real  root  of  <|)((a), r*)  = 0 in  [0,1).  If 
for  some  w no  such  root  exists  take  r*(w)  = 0. 

Then 


4>(a),r)  >0  V r r*(&>)<r<l 


If  we  choose 
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^^min  = [r*(o))] 

(ji 


then 


<Kw,r)  >0  V r r^in<r<l 

and  V (d  0<(0<n 

and  condition  (ii)  of  Theorem  5.1  is  satisfied.  Therefore  Tq  is  stable. 

Next  we  show  that  there  exists  f^i^  such  that  V f (fn,^jj<f<l) 
condition  (iii)  of  Theorem  5.1  is  satisfied. 

First,  note  that  condition  (3)  of  Theorem  5.2  and  Remark  5.1  prove 
condition  (iii.b).  Then  the  rest  of  the  proof  is  the  same  as  in  Theorem 
A.l. 


CHAPTER  VI 

ADAPTIVE  MODEL  DEPENDENT  CONTROL 


Introduction 


Adaptive  controllers  based  on  the  Model  Dependent  Control  design 
method  are  presented  in  this  chapter.  MDC  combines  a pole/zero  placement 
design  method  for  regulation  and  the  Internal  Model  Control  approach  for 
set-point  following.  The  closed-loop  performance  depends  on  two 
parameters,  one  determining  the  closed-loop  poles  for  disturbance 
rejection  and  the  second  the  closed-loop  poles  for  set-point  tracking. 

Adaptive  MDC  belongs  to  the  class  of  indirect  adaptive  controllers 
(Goodwin  and  Sin,  1984,  p.  181)  where  the  model  parameters  are  estimated 
on-line,  and  the  control  law  is  updated  using  the  current  estimates. 
Stability  and  convergence  analysis  for  indirect  adaptive  control  has  been 
a real  challenge  in  recent  years.  The  main  reason  is  that  the  on-line 
identified  model  may  not  be  stabilizable;  i.e.  an  unstable  pole-zero 
cancellation  may  occur. 

Many  methods  have  been  proposed  to  overcome  this  problem.  One  way 
is  to  restrict  the  parameter  estimates  in  a region  where  the  model  is 
always  stabilizable  (Goodwin  and  Sin,  1981;  De  Larminat,  1984; 
Kreisselmeier , 1985).  The  persistency  of  excitation  condition  was  used 
by  Elliot  et  al.  (1985),  and  Anderson  and  Johnstone  (1985)  to  establish 
parameter  convergence  to  their  true  values  (it  is  assumed  that  the  system 
is  stabilizable)  and  thus  avoiding  the  pole-zero  cancellation.  A method 
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which  alleviates  the  need  for  external  exciting  inputs  was  proposed  by 
Leal  and  Goodwin  (1984).  The  idea  is  to  modify  the  estimates  before 
using  them  so  as  to  avoid  pole-zero  cancellations  and  yet  retain  the 
other  estimator  properties.  Note  that  all  these  methods  affect  only  the 
estimator  and  are  independent  of  the  control  design  method.  Any  of  these 
methods  can  be  used  in  the  adaptive  MDC  framework  since  all  of  them 
satisfy  the  estimator  properties  required  to  prove  MDC  stability  and 
convergence. 

Given  that  the  identified  model  is  always  stabilizable,  the 
stability  and  convergence  of  many  indirect  adaptive  schemes  has  been 
established.  The  asymptotic  stability  of  pole-placement  algorithms  has 
been  proved  in  Goodwin  et  al.  (1984),  Elliot  et  al.  (1985,  and  Anderson 
and  Johnstone  (1985),  while  Samson  et  al.  (1981)  and  Kreisselmeier 
(1985),  showed  the  convergence  of  adaptive  optimal  control  methods.  It 
should  also  be  mentioned  that  recently  Ossman  and  Kamen  (1986)  and  Ossman 
(1986)  developed  and  proved  convergence  for  an  adaptive  optimal  control 
algorithm  that  does  not  require  pointwise  stabilizability  of  the 
estimated  model.  Instead  they  use  an  estimator  that  forces  the  estimates 
to  converge  to  a stabilizable  region. 

All  control  algorithms  described  above  require  knowledge  of  the 
exact  system  order  (and  in  some  cases  of  the  time  delay)  for  the 
following  reason:  if  the  order  is  overestimated  the  model  is  not 
stabilizable  and  if  underestimated  the  estimator  does  not  converge.  Not 
such  an  assumption  is  made  here.  The  only  a priori  knowledge  required  is 
an  upper  bound  of  the  process  order  (which  is  a minimal  requirement  for 
adaptive  control),  and  some  limited  information  about  the  process  gain. 
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Two  different  adaptive  MDC  algorithms  are  developed  next.  For  the 
first  one,  the  parameters  that  specify  the  location  of  the  closed-loop 
poles  are  constant.  This  algorithm  is  destined  for  application  to 
systems  that  are  essentially  linear  and  will  be  referred  to  as  Fixed 
Adaptive  MDC  (FAMDC).  The  second  algorithm  is  developed  with  non-ideal 
situations  in  mind  like  those  described  in  Chapters  II,  III,  and  V.  For 
this  case  the  two  MDC  parameters  are  tuned  on-line  depending  on  a measure 
of  the  plant/estimated  model  mismatch  and  the  control  algorithm  will  be 
referred  to  as  Cautious  Adaptive  MDC  (CAMDC).  This  can  be  viewed  as  an 
extension  of  the  cautious  controller  design  method  presented  in  Chapters 
III  and  V that  allows  non-minimum  phase  and/or  open-loop  unstable  systems 
to  be  treated. 

Adaptive  MDC  can  be  recast  into  a pole-zero  placement  algorithm  but 
with  an  important  difference  from  other  similar  controllers:  the  target 

clsoed-loop  poles  are  time  varying.  For  this  reason  the  stability  and 
convergence  of  the  MDC  cannot  be  deduced  from  already  existing  results. 
MDC  stability  and  convergence  are  examined  in  this  chapter  combining 
linear  time  varying  operator  and  estimator  properties. 

The  performance  of  both  algorithms  is  demonstrated  by  simulations  on 
the  continuous  stirred  tank  reactor  presented  in  Chapter  III. 

Adaptive  MDC  Law 

It  is  assumed  that  the  process  to  be  controlled  is  described  by 

A(q"^)  y(t)  = B(q-l)  u(t)  + d(t)  (6-1) 

where  y(t)  is  the  output,  u(t)  is  the  input,  A(q“l),  B(q~^)  are 

polynomials  in  the  backwards  shift  operator  given  by 
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A(q"^)  = I - ai  q"^  - &2  q"^  - ...  - q~"  (6-2) 

B(q~^)  = q”^  + ...  + b]^  q“^  ; 1 < n (6-3) 

and  d(t)  accounts  for  disturbances  that  without  loss  of  generality  may  be 
considered  as  the  sum  of  a constant  and  a time  varying  term 

d(t)  = d + d(t)  (6-4) 

The  following  assumptions  are  made  for  the  process  (6-1) 

Al.  An  upper  bound  n of  the  system  order  is  known. 

A2.  The  system  is  stabilizable,  i.e.  A(q“^)  and  B(q“^)  do  not  have  a 
common  unstable  zero. 

It  is  not  assumed  here  that  the  leading  coefficients  of  B(q“^)  are 
nonzero,  thus  allowing  for  an  unknown  time  delay.  However,  it  is  assumed 
that  the  sign  of  B(l)  as  well  as  a lower  bound  of  its  magnitude  are 
known , i.e. 

A3,  sign  B(l)  is  known  and 

|B(1)I  > 

A4.  The  disturbances  are  asymptotically  time  invariant,  i.e. 
d(t)  = 0 

and 
00 

Z d2(i)  < 
i=l 


00 
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Rewrite  (6-1)  as 

y(t)  = x'^(t-l)0  + d(t)  (6-5) 

where 

xT(t-l)  = [y(t-l)  ...  y(t-n)  u(t-l)  ...  u(t-l)  1]^ 

0 — f^l  •••  ...  b^  d]*^ 

The  unknown  parameters  are  estimated  on-line  and  using  the  estimates  at 
time  t we  form  the  time  varying  operators 

A(t,q-1)  = 1 - ai(t)q-l  - a2<t)  q"2  - ...  - an(t)q~^  (6-6) 

B'(t,q-1)  = bi(t)  q-1  + b2(t)q~2  + ...  + bi(t)q“^  (6-7) 

where  a^(t)  (i=l n),  bj(t)  (j=l,...,l),  and  d(t)  are  the  estimated 

parameters  at  time  t. 

The  MDC  law  requires  factorization  of  the  polynomial  B'(t,q~^). 
This  factorization  is  ill-conditioned  whenever  the  leading  coefficients 
of  B(t,q  •'•)  become  very  small  and  may  result  to  unbounded  control  law 
operators.  To  overcome  the  problem  leading  coefficients  absolutely 
smaller  than  a prescribed  number  are  discarded,  and  B'(t,q“^)  is  reduced 
to  the  following  well-conditioned  for  factorization  polynomial 

B(t,q-1)  = bk^(t)(t)q-k(t)  + . . .+b^^^j(t)q-'"(t)  1 < k(t)  < m(t)  < 1 

with 


|bk(t)(t)|  > ti  , |b„,(t)|  > ti 
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and 

|bj(t)|  < El  j = 1,  k(t)-l,  m(t)+l 1 

Note  that  small  trailing  coefficients  of  B'(t,q~l)  are  also  discarded, 
and  this  may  reduce  significantly  the  factorization  calculations.  This 
is  equivalent  to  taking  all  zeroes  of  B'(t,q~^)  close  to  the  origin  equal 
to  zero. 

The  adaptive  MDC  laws  are  then  obtained  using  the  algorithm 
described  in  section  5.4  by  substituting  at  each  sampling  interval  the 
unknown  polynomials  A(q~^),  B(q~l)  with  the  estimated  A(t,q~^),  B(t,q”^), 
respectively.  Since  there  are  some  differences  in  the  adaptive  case  the 
algorithm  is  repeated  here: 


0.  Choose  a small  positive  < b^j^jj/1 

1.  Find  Pniax(t) 


Pmax(^)  - {|^i(t)l  + i = 1,  ...,  n ; 62  > 0 

where  X^(t)  is  the  ith  zero  of  A(t,z“^)  = 0,  and 


= 0 if  \ax  < 1 - ; a > 0 


‘^^lax 

^ if  W > 1 - 

1-a 


\iax  “ { I t ) I } 

i 
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The  above  choise  for  Z2  guarantees  that 
\iax 

< 1 - CT 

Pmax 

It  is  noted  that  can  be  obtained  numerically  without 

A(t,q-^). 

2.  Factor  B(t,q“^)  as 

^ ^ • 

B(t,q-1)  = B_(t,q-1)  B^(t,q"l) 

with 

B(t,q-1)  = 3(t)  n (l-zj(t)q-l)  i = 1,  li(t) 
ll(t)  * 1 

3(t)  = (-1)  b„,(t)(t)  n 

i Zi(t) 

1 

B+(t,q-l)  = q-k(t)  n (-  _ + q-1)  j = 1 l2(t) 

j zj 

ll(t)  + l2(t)  = m(t)  - k(t) 
and  form 

B+(t,q-l)  = n (-Zi+(t)  + q-1)  i = 1,  l3(t) 

i 

13(0  < l2(0 

where 

|zi|<l-ff  0<ff<l 

|zj|  > 1 - a 


(6-9) 

factoring 

(6-10) 

(6-11) 

(6-12) 

(6-13) 

(6-14) 
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and  |Z+|  denotes  those  z+  with  jz+j  > 1.  Note  that  a is  usually  a 
small  positive  number. 

The  factorization  employed  here  is  different  from  the  factorization 
presented  in  section  5.4.  The  reason  is  explained  at  the  end  of  this 
section  in  Remarks  6.1  and  6.2. 


3.  Form 


= (l-f(t)q-l)  B^(t,q-1) 


(6-15) 


FN<t)  = l-f(t) 


C(t,q-1)  = A(t,q-1)  FD(t,q-l) 


(6-16) 


= 1 + C2(t)q~^  + ...  + Cn(,(t)q  ”c 


and 


n^.  (t)  = n + l3(t)  + 1 


4.  Form  the  polynomial 


T(t,q-1)  = 1 + Ci(t) 


Pmax( 


r 


•q 


-1 


'Pmax(^) 


r 


(6-17) 


and  solve  the  Bezoutian 


T(t,q-1)  = C(t,q-l)Qi(t,q-l)  + B^( t , q-l)P( t , q'^) 
to  find  the  polynomials  Qi(t,q-1)  and  P(t,q"^),  where 
deg(P(t,q-l)  = n^,(t)  - 1 


(6-18) 
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deg(Qi(t,q-l)  = k(t)  + l2(t)  - 1 
5.  Form  the  operator 

^ M ^ • 

K(t,q-1)  = Fu(t,q-1)  [Qi( t , q~l)A( t , q~l)FN( t ) + P(t,q-1)]  (6-19) 

and  check  if  the  zeroes  of 

“ ^ A * ^ ^ 

T(,(t,q-1)  = B_(t,q--)Fi)(t,q-l)T(t,q-l)  + [B'(t,q-l)-B(t,q-l)]K(t,q-l) 

(6-20) 

are  inside  the  unit  circle.  If  not  reduce  by  taking 

El  = raax|bj(T)|  j = 1,  k(t)-l,  m(t)+l,  1 (6-21) 

so  as  to  include  more  terms  in  B(t,q“^)  and  go  to  step  2. 

As  shown  later  this  step  is  crucial  in  proving  the  stability  of  the 
MDC  law.  At  most  1 iterations  are  required  to  find  a B(t,q~^)  such 

that  T(t,q~-^)  is  stable  (for  at  most  1 iterations  B'  = B and  = B_ 

Fj)  T).  See  Remark  6.2  below  for  some  implementation  aspects. 


6.  Obtain  the  MDC  law  from 

• • • 

H(t,q-l)u(t)  = -K(t,q-l)y(t)  + R( t ,q-l)ygp( t)  (6-22) 

where 

H(t,q-1)  = Q(t,q-l)B_(t,q-l)[FD(t,q-l)-B^(t,q-l)FN(t)]  (6-23) 

Q(t,q-1)  = Qi(t,q-l)F£)(t,q-l)  (6-24) 

R(t,q-1)  = Fig(t)T(t,q-l)  (6-25) 
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In  the  case  of  FAMDC  the  parameters  f and  r are  prespecified 
constants  and  Fjj  is  a constant.  In  the  case  of  CAMDC  they  are  time 
varying  as  prescribed  next  in  section  6.3. 

Remark.  6.1 

The  factorization  (6-10)-(6-14)  ensures  that  B^(t,q"^)  and 
have  bounded  coefficients  since 


1 1 

0 < < 

z+(t)  1 - a 

In  addition,  suppose  that  the  coefficients  of  B'(t,q~^)  are  bounded 
and  that  > Si^niin  ^ Then  B_(t,q“^)  has  bounded  coefficients  and 

its  leading  coefficient  0(t)  is  bounded  away  from  zero. 


Proof.  First  note  that 


^ra(  t ) ^ ^ ^ 

n zi(t)  n z+(t)  = 

i j bk(t)(t) 


and  since  < b„,in/l. 


0 < 


< ® 


bk(t)(0 


The  last  inequality  means  that  the  magnitude  of  the  zeroes  of  B(t,q~^)  is 
bounded  away  from  zero  and  infinity,  i.e.  for  every  there  exists  £3 
such  that 
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0 < £3  < |zj|  < 1 


1 

1-(T<|Z+|  < <® 

S3 

and 


M 

ti  < |p(t)|  < < ® 

ll<t) 

S3 


(6-26) 


(6-27) 


(6-28) 


where  M is  an  upper  bound  on  the  coefficients  of  B'(t,q”^). 

Then  follows  from  (6-11)  and  Lemma  D.2(i)  that  B_(t,q“^)  is  bounded. 

Remark  6.2 

Step  5 of  the  adaptive  MDC  algorithm  requires  to  check  the  stability 
of  T^(t).  If  is  chosen  sufficiently  small,  one  iteration  of  the 

algorithm  will  suffice  in  most  cases  in  practice.  In  addition,  it  is  not 
required  to  utilize  a necessary  and  sufficient  condition  for  stability 
(e.g.  the  Jury  test).  Instead  a much  simpler  sufficient  condition 
derived  below  may  be  used. 

From  (6-20),  dropping  the  arguments  t and  q~^ 

* ^ A A A 

Tc  = B_  Fq  T + B K (6-29) 

where 


B = B'  - B 


(6-30) 
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In  view  of  (6-19) 

K = Fd  Ki 

and  substituting  the  above  in  (6-29)  we  obtain 

* * • Kl  - 

Tc  = B_  Fd  T (1  + B) 

B_  T 

Then  a sufficient  condition  for  stability  is  given  by 
|Kl(z-^)l  1 

< for  z = eJ“  0<w<n 

|B_(z-l)T(z-l)|  |B(z-l)| 

where  z substitutes  q and  the  argument  t is  omitted.  Note  that 

|Ki(z-l)|  < Z Ikiil 
i 

where  denotes  the  ith  coefficient  of  Kj^(z“^).  Also 

|B(2“1)|  < 1 1=1+  k(t)  - m(t)  - 1 

Let 

^max  = ^ I i I 
i 

and 

‘^min  = |B_(e~j“)  T(e-j“)|  0 < « < n 

Oi 


(6-31) 


(6-32) 


(6-33) 


(6-34) 


(6-35) 


Using  (6-33)-(6-35)  we  can  easily  show  that  (6-32)  is  satisfied  if  the 
following  is  true 
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^max  ^ 

< (6-36) 

•^min  ^ 

It  can  be  shown  that 

• * A A 

d^in  = min  [|B_(1)  T(l)|,  |B_(-1)  T(-l)|]  (6-37) 

Then,  (6-36)  and  (6-37)  constitute  an  easily  implementable  sufficient 
condition  for  the  stability  of  Tj.(t,q“^). 

It  is  proved  in  Lemma  D.3  that  there  exists  an  e^^^niax  greater  than 
zero  such  that  (6-36)  is  satisfied  if  = ®l,max  every  time. 

Cautious  Adaptive  HOC  Tuning 

The  adaptive  controller  is  based  on  a linear  time  invariant  process 
model  identified  on-line.  If  the  actual  process  is  time  varying  and/or 
nonlinear,  the  estimated  model  may  describe  the  process  poorly  for  the 
reasons  explained  in  Chapters  II  to  IV. 

Since  in  the  adaptive  case  the  model  uncertainty  is  varying,  the  MDC 
tuning  parameters  should  be  varying  too.  For  simplicity  in  tuning,  the 
CAMDC  is  designed  to  have  only  one  free  parameter  by  taking 

f(t)  = min  [r(t),  1 - ct] 

Following  the  same  guidelines  as  in  Chapters  II  to  IV,  if  the  model 
uncertainty  is  large  r(t)  takes  values  close  to  one  and  leads  to  a 
conservative  but  robust  control  action  at  least  for  open-loop  stable 
systems.  As  the  model  improves  r(t)  decreases  to  speed  up  response. 
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Specifically,  r(t)  is  given  by 

r(t)  = pr(t-l)  + (l-p)y(t)  0 < p < 1 


(6-38) 


Here 


U(t)  + [1 


with 

P(t) 

yi(t)  = — , 

5|bk:(t)(t)l  + P(t) 

^ - ^min  ^ ^ 

where  p(t)  >0  is  a measure  of  the  plant/model  mismatch  obtained  from  the 
estimator.  Note  that 


^min  ^ 


< 1 


and  for  a perfect  model  (p(t)  = 0)  r(t)  = r^^jj* 

The  measure  of  the  plant/model  mismatch  is  chosen  as 


|e(t)| 

= TTT 

[X(t)  + w(t-l)]l/2 

where  e(t)  is  the  prediction  error,  and  X(t),  w(t-l)  are  estimator 

quantities  defined  in  Appendix  B.  It  is  proved  in  Appendix  B that  for 
linear  deterministic  systems  p(t)  = 0 and  consequently 

tiS  r(t)  = r^i„  (6-39) 
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which  is  a key  property  in  establishing  the  controller  stability  as  shown 
next. 


Stability  and  Convergence  Analysis  of  Fixed 
Adaptive  MDC  and  Cautious  Adaptive  MDC 

The  stability  of  the  algorithms  will  be  studied  using  the  closed- 
loop  equations  relating  the  process  inputs  and  outputs.  It  is  obvious 
from  (6-1)  and  (6-13)  that  these  equations  involve  time  varying 
operators.  Hence,  it  is  not  possible  to  obtain  the  closed-loop  equations 
by  direct  manipulation  of  (6-1)  and  (6-13).  The  problem  is  that  the 
convolution  of  time  varying  operators  does  not  commute,  e.g. 

H(t,q-1)  • B(t,q-1)  t B(t,q-1)  • H(t,q"l) 

Instead,  the  operator  product  (as  a polynomic  product)  commutes,  e.g. 

H(t,q-1)  B(t,q-1)  = B(t,q"l)  H(t,q"l) 

In  Appendix  D,  some  properties  of  linear  time  varying  operators  are 
derived  and  then  used  to  obtain  the  closed-loop  system  equations. 

The  aim  is  to  express  the  closed-loop  behavior  in  terms  of  known 
time  varying  operators  and  quantities  depending  on  estimator  properties, 
which  are  next  invoked  to  prove  stability. 

A minimal  set  of  properties  that  the  estimator  should  satisfy  in 
order  to  prove  stability  is  given  next. 
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Estimator  Properties 

It  is  assumed  here  that  the  estimator  has  the  following  properties: 

El.  The  parameter  estimates  0(t)  are  bounded,  i.e.  |6(t)|  < M 
E2.  |0(t)  - 0(t-i)|  =0  0 < i < ® 

E3.  |e(t)|  < 8i(t)  + 82(t)  |x(t-l)| 

ln(t)|  < 8i(t) 

where 

e(t)  = y(t)  - xT(t-l)  0(t-l) 
is  the  a priori  prediction  error, 

n(t)  = y(t)  - xT(t-l)  0(t)  (6-40) 

is  the  aposteriori  prediction  error,  and 

0 < S2(t)  < ® , iiS  §2(0  = 0 

0 < &i(t)  < ® 

Since  d(t)  is  a asymptotically  invariant 

6l(t)  . 0 

and 

n(t)  = 0 

E4.  The  estimator  ensures  that  B^(t)  and  A(t)  are  coprime  for  any  time  t 
(pointwise  stabilizability) . 

E5.  The  estimator  ensures  that  B'(l)  has  the  right  sign  and  that 

|B'(1)I  > 

E6.  The  parameter  estimates  converge,  i.e. 

iiS  9(t)  = 0„ 

Note  that  0a,  is  not  necessarily  equal  to  the  true  parameter  vector 


0. 


93 


An  estimator  that  satisfies  all  the  above  properties  is  given  in 
Appendix  B.  It  is  based  on  the  least  squares  estimator  described  in  Leal 
and  Goodwin  (1984)  which  satisfies  E1-E4  and  E6.  A modification 
described  in  Goodwin  and  Sin  (1984,  p.  91)  is  also  employed  so  that  the 
estimator  satisfies  in  addition  the  parameter  constraints  of  E5. 

The  stability  and  convergence  analysis  that  follows  is  not 
restricted  to  any  particular  estimation  scheme  but  is  valid  for  any 
estimator  satisfying  E1-E6. 

The  Time  Varying  Closed-Loop  System 

It  is  proved  in  Appendix  D that  the  closed-loop  system  satisfies  the 
equations  given  next  in  Lemma  6.1.  Henceforth  q“^  is  suppressed. 

Lemma  6.1 

The  closed-loop  dynamics  for  the  fixed  adaptive  and  cautious 
adaptive  MDC  are  described  by 


y(t)- 

■B(t)' 

■ ■ 

■ H(t)- 

■ H(t)- 

-u(t). 

A(t). 

R(Oysp(t) 

+ 

--K(t). 

n(t) 

--K(t). 

d(t) 

'ABK(t)  + AHA(t)  ABH(t)  - AHB(t)' 

y(t)- 

.AAK(t)  - Ai^(t)  AAH(t)  + AO(t). 

-u(t). 

(6-41) 


where  A--(T)  represents  operators  defined  from  (D-13)  in  Appendix  D,  and 
T(,(t)  is  given  by  (6-20). 
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For  convenience  we  rewrite  (6-41)  as 


Tp(t) 


y(t)- 

■ii(t)- 

-u(t). 

(6-42) 


where  the  definition  of  l]^(t)  and  l2(t)  is  obvious  upon  inspection  of  (6- 
41)  and  (6-42). 

To  prove  stability  from  (6-21),  we  will  need  the  following  Lemmas. 


Lemma  6.2 

The  closed-loop  polynomial 


Tc(t,q  ^)  - To(t)  + Ti(t)q-1  + ...  + Tn^(t)q-‘'T 


(6-43) 


(with  n^  being  the  maximal  order  of  T^.(t)  for  all  times)  has  the 
following  properties: 
i-  l'To(0|  > £4  > 0 

ii.  The  coefficients  'Cj(t)  (i  = 0,  ...,  n^p)  are  bounded  and  satisfy 


lim 

t-K» 


'Ci(t) 


ti(t-j) 

•coCt-j) 


= 0 


0 < j < ® 


(6-44) 


iii.  For  all  times  t,  all  zeroes  of  T,,(t,z  ^)  lie  inside  a circle  in  the 
complex  plane  with  radius  l-<r;  in  other  words  Tj,(t,q“^)  is  pointwise 


stable. 
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Proof. 

i,ii. These  properties  are  consequence  of  the  estimator  properties  E1-E6 
and  follow  easily  from  (6-20)  and  Lemmas  D2,  D3  of  Appendix  D.  A 
formal  proof  is  given  in  Appendix  D. 

iii.  This  is  true  by  construction  (step  5 of  the  adaptive  MDC  algorithm). 


Lemma  6.3 

The  scalar  system 

Tc(t,q-l)W(t)  = l(t)  (6-45) 

is  exponentially  stable  after  some  finite  time  to,  and  satisfies 


|W(t)|  < Ci(t)  + C2I |l(t)| |„  t > to 


(6-46) 


where 


l|l(t)||a.  = Olflt  Il(i)l 


and 


0 < Ci(t)  < « , JiS  Ci(t)  = 0 


0 < C2  < ® 


Proof.  The  system  defined  from  (6-43)  and  (6-45)  admits  the 
following  state-space  representation  in  the  controllable  canonical  form 
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Z(t+1)  . M(t)Z(t)  + M(t)l(t) 
W(t)  = C Z(t+1) 

where 


Tl(0 

V . • « • • 

■Co(t)  '^0(O 

■CO(^) 

M(t)  = 

1 0 

0 1 

• • 

• 

• 

0 

• • 0 

Z(t)  = [W(t-l)W(t-2)  ...  W(t-nT)]'^ 

■ 1 IT 

N(t)  = 0 ...  0 

C = [1  0 ...  0]T 

Lemma  6.2  implies  that  the  time  varying  matrix  M(t)  satisfies 
I |M(t)| I < » V t 

JiS  ||M(t+l)  - M(t)||  = 0 


(6-47) 

(6-48) 

(6-49) 


(6-50) 

(6-51) 


|Xj(M(t))|  < 1 - ff  < 1 , 


<j  > 0 


(6-52) 


97 


where  ll’M  denotes  the  induced  Euclidean  matrix  norm,  and  Xj(M(t))  is 
the  jth  eigenvalue  of  M(t).  Equation  (6-50)  follows  from  property  (i)  of 
Lemma  6.2,  (6-51)  from  (6-44),  and  (6-52)  from  property  (iii)  of  Lemma 

6.2. 

It  has  been  proved  in  Desoer  (1970)  that  if  M(t)  satisfies  (6-50), 
(6-52)  and  is  slowly  time  varying  in  the  sense  that 

syP  I |M(i+l)  - M(i)| I < 8 < ® (6-53) 

where  5 is  a constant  depending  on  system  parameters,  then  the  autonomous 
system  resulting  from  (6-47)  for  l(t)  = 0 is  exponentially  stable. 

Equation  (6-51)  implies  that  there  exists  a finite  time  tQ  such  that 

sup  I |M(t+l)  - M(t)| I < 8 

to<t 

Then,  the  system 

Z(t+1)  = M(t)Z(t)  Z(tQ)  = Zq  (6-54) 

W(t)  = C Z(t+1)  t > to 

is  exponentially  stable.  This  implies  that  the  transition  matrix  of  (6- 
54) 

t-1 

♦(t,to)  = n M(i) 
i=to 


» «4r 
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satisfies 


I |<Kt,to)l  I < KX 


t-to 


0<X<1;  0<K<® 


(6-55) 


Now  the  input-output  stability  of  the  forced  system  (6-47)  can  be  studied 
in  terms  of  the  transition  matrix  ♦(tjtQ).  Note  that  exponential 
stability  for  a time  varying  linear  system  does  not  in  general  imply  BIBO 
(or  loo)  stability.  Therefore,  BIBO  stability  should  be  directly  proved 
from  (6-55)  and  (6-47). 

The  solution  of  (6-47)  is  given  by 


Taking  norms  on  both  sides  of  (6-56)  and  using  (6-48)  (note  |C|=1)  we 
obtain 


t 


Z(t+1)  - ♦(t,tQ)Zo  + Z ♦(t,T)N(T)l(T) 

t=to 


(6-56) 


From  property  (i)  of  Lemma  6.2  |TQ(t)|  > £4  > 0 and  therefore 


1 

|N(t)|  < N = _ < ® 
^4 


(6-57) 


Using  (6-55)  into  (6-57) 


t-to 

|W(t) I < KX  IZqI  + NK 


(6-58) 
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Noting  that 


t 

Z 

t=to 


t-to 

z 

i=0 


1 

< 

1-X 


and  substituting  the  above  into  (6-58)  we  obtain 


|W(t)|  < Ci(t)  + C2  Ml(t)||„ 


where 


KN 

0 < Co  = < ® 

1-X 


and 


t-tQ 

0 < Ci(t)  = KX  |Zo)|  < » 

Since  tQ  is  finite,  Zq  is  bounded  and 

Jis  Ci(t)  = 0 
q.e.d. 

Lemma  6.4 

If  the  estimator  satisfies  the  properties  E1-E6,  then  the  RHS  of  (6- 
41)  satisfies 


|ll(t)l  < Yi  + Y2<t)  [| |u(t)|  U + i |y(t)i |„] 


(6-59) 
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|l2(t)l  < Si  + S2(t)  [||u(t)||co  + ||y(t)||„]  (6-60) 

where 

0 < Yi»  S^  < » 

0 < Y2(t),  S2(t)  < » 
iiS  Y2(t)  = S2(t)  = 0 

Proof.  The  Lemma  follows  easily  from  estimator  properties  E1-E4.  A 
formal  proof  is  presented  in  Appendix  D. 

Bringing  all  the  pieces  together,  we  formulate  the  final  stability 
and  convergence  theorem  for  the  Adaptive  MDC  algorithms. 

Theorem  6.1 

If  the  estimator  satisfies  E1-E6,  then  the  FAMDC  and  CAMDC 
algorithms  result  to 

i.  bounded  input  and  output  variables,  i.e. 

l|u||.<M  (6-61) 

I |y| l»  < M 

where  | | • | | „ = | 1 • ( i ) | | is  the  loo  norm 

ii.  closed-loop  performance  described  by 
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lim 


Boo  R(ja 

y(t)  - — ysp(0 

. T — m 


= 0 


Proof. 


i.  From  (6-42)  and  Lemma  6.3 


|y(t)|  < Ci(t)  + C2  ||li(t)|U 

|u(t)|  < Ci(t)  + C2  I |l2(t)| U 

which  in  view  of  Lemma  6.4  yield 

I |y(t)|  |»  < Si  + S2(t)  I |y(t)|  |„  + S2(t)  ||u(t)|U 

||u(t)||„  < Si  + S2(t)  I |y(t)|  U + S2(t)  |lu(t)|U 

where 

0 < Si  < ® 

0 < S2(t)  < ® and  S2<t)  = 0 

Then  from  (6-63)-(6-64) , and  the  Small  Gain  Theorem 

1 |y| l»  < » 

I |ui |„  < » 


(6-62) 


(6-63) 

(6-64) 


q.e.d. 
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ii.  Since  d(t)  is  bounded  and  asymptotically  constant  (see  Appendix  B) 
the  estimated  parameters  converge.  This  implies  that  in  the 
infinite  time  limit  all  time  varying  operators  converge  to  time 
invariant  ones.  Then  we  obtain  from  (6-41) 


where  the  subscript  ® denotes  the  invariant  operators  obtained  at 
the  infinite  time  limit.  The  last  term  is  zero  since  H„(q-l=l)  = 0 
by  design,  and  (6-62)  follows  from  (6-65). 


The  FAMDC  and  the  CAMDC  performance  is  demonstrated  on  the  same 
stirred  tank  reactor  used  in  Chapter  III. 

The  controller  tested  here  use  the  UDU  factorization  of  the 
recursive  least  squares  estimator  with  variable  forgetting  factor  and 
parameters  as  in  Table  3.2. 

Figures  6-1  to  6-3  examine  the  performance  of  FAMDC  and  Figure  6-4 
that  of  CAMDC  with  respect  to  set-point  tracking  for  a sequence  of  set- 
point  changes.  Figure  6-1  presents  the  performance  of  FAMDC  for  f = r = 
0 which  aims  at  maximum  speed  and  is  equivalent  to  MV  control.  Large 
oscillations  in  both  the  output  and  the  control  variable  are  observed  as 
is  also  the  case  in  Figure  3-1  for  the  MV  control  law.  More  robust 
solutions  are  obtained  by  increasing  f and  r.  Figure  6-2  depicts  the 


lim 

t-xa 


(6-65) 


Example 
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FAMDC  performance  for  f = r=  0.5  and  Figure  6-3  for  f = r = 0.7.  It  is 
clearly  seen  from  these  figures  that  increasing  f and  r slows  down  the 
response  but  it  also  eliminates  the  oscillatory  behavior.  Small  f and  r 
perform  well  if  the  plant/model  mismatch  is  small  but  performance 
deteriorates  as  soon  as  the  modeling  error  increases.  This  is  clearly 
shown  in  Figure  6-2  where  for  some  of  the  set  points  the  controller 
performs  fairly  well,  but  for  others  (second  and  fourth)  the  performance 
deteriorates  due  to  a poor  estimated  model.  Performance  improves  as  soon 
as  the  modeling  error  drops.  It  takes  an  increase  of  f from  0.5  to  0.7 
(r=f)  to  improve  robustness  and  eliminate  oscillations  as  seen  from 
Figure  6-3.  However,  this  is  achieved  at  the  expense  of  overall 
performance  as  seen  from  the  same  figure.  In  Figure  6-4  the  performance 
of  the  CAMDC  for  = 0 is  shown.  The  last  plot  in  this  figure  is  that 
of  f(t)  = r(t).  It  is  seen  that  f(t)  increases  after  each  set-point 
reflecting  the  increase  in  modeling  error  due  to  the  fact  that  the  plant 
is  nonlinear.  This  way  the  oscillatory  behavior  of  Figures  6-1  and  6-2 
is  eliminated.  As  the  modeling  error  drops,  f(t)  decreases  improving 
performance. 

Figures  6-5  to  6-7  show  the  FAMDC  performance  with  respect  to 
regulation  around  the  set-point  ygp  = 0.05  and  for  the  same  sequence  of 
disturbance  changes  as  in  Figure  3-11  for  the  CSTC.  The  same  behavior  as 
in  Figures  6-1  to  6-3  is  repeated  here.  For  r = f = 0 (Figure  6-5)  fast 
disturbance  rejection  is  observed  at  the  expense  of  oscillatory  behavior. 
As  r = f increases  (Figure  6-6  and  6-7)  oscillations  are  reduced 
drastically.  Finally,  Figure  6-8  depicts  the  CAMDC  performance  for  the 
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same  set  of  disturbance  changes  as  in  Figures  6-5  to  6-7.  It  is  seen 
again  that  r(t)  = f(t)  is  adjusted  on-line  so  as  to  eliminate 
oscillations  when  needed  and  ultimately  not  to  restrict  the  closed-loop 
performance. 
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Figure  6-1.  FAMDC  with  f=r=0  for  set-point  changes. 
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Figure  6 2.  FAMDC  with  f— r— 0.5  for  set— point  changes. 
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Figure  6-3.  FAMDC  with  f=r=0.7  for  set-point  changes. 
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Figure  6-4.  CAliDC  with  f(t)=r(t)  for  set-point  changes. 
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Figure  6-5.  FAMDC  with  f=r=0  for  load  changes. 
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Figure  6-6.  FAMDC  with  f=r=0.5  for  load  changes. 
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Figure  6-7.  FAMDC  with  f=r=0.7  for  load  changes. 


112 


Figure  6-8.  CAlfflC  with  f(t)=r(t)  for  load  changes. 


CHAPTER  VII 

ADAPTIVE  CONTROL  FOR  WASTEWATER  TREATMENT  PROCESSES 


Introduction 


Process  control  is  unanimously  accepted  today  as  an  effective  way  of 
improving  the  performance  and  reducing  the  operating  costs  of  wastewater 
treatment  processes.  It  is  traditional  design  practice  to  increase  the 
size  of  the  process  in  order  to  accommodate  large  load  variations. 
Recent  improvements  in  sensor  reliability  and  inexpensive  computer 
systems  make  process  control  an  attractive  alternative  to  overdesign  and 
a powerful  method  of  operating  the  treatment  process  so  that  they  meet 
the  environmental  standards  at  a minimum  cost. 

Since  the  inputs  of  a treatment  process  are  usually  varying  with 
period  of  one  day,  the  plants  are  rarely  operating  at  steady-state 
conditions.  For  this  reason,  there  has  been  a strong  interest  in  the 
development  of  dynamic  models  for  those  processes.  The  importance  of 
dynamic  modeling  and  process  control  for  the  activated  sludge  process  is 
effectively  illustrated  in  the  pioneering  work  of  Andrews  (1974)  and 
Busby  and  Andrews  (1975).  Most  of  these  models  are  nonlinear,  time 
varying,  of  large  dimensionality  and  involve  a large  number  of  parameters 
to  be  fitted.  Simpler  models  have  been  also  developed  which  adequately 
describe  the  dynamic  performance  of  the  activated  sludge  process.  Such 
examples  are  transfer  function  models  e.g.  Lech  et  al.  (1978a, b)  and  time 
series  models  e.g.  Berthouex  et  al.  (1978),  and  Debelak  and  Sims  (1981). 
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The  linear  models  are  more  appropriate  for  controller  design  whereas  the 
complicated  nonlinear  ones  are  invaluable  tools  for  process  simulation 
and  controller  testing. 

In  a survey  paper,  Olsson  (1977)  discussed  the  problems  of 
traditional  treatment  processes,  the  objective  for  their  operation  and 
the  state-of-the-art  control.  The  main  control  objectives  for  the 
activated  sludge  process  can  be  summarized  as:  a)  improve  the  quality 
and  minimize  the  quality  variation  of  the  effluent  stream,  b)  minimize 
the  influence  of  feed  diurnal  variations  on  the  physiological  state  of 
the  biological  matter,  and  c)  reduce  operating  costs. 

Standard  control  strategies  today  include:  solids  retention  time 
(SRT)  control,  food  to  mass  ratio  (F/M)  control,  and  sludge  blanket  level 
(SBL)  control.  Most  of  these  strategies  aim  at  improving  the 
settleability  of  the  biological  floe  and  at  keeping  a constant  amount  of 
activated  sludge  in  the  system  despite  any  load  variations.  Examples  of 
such  applications  of  process  control  are  reported  in  Grinker  and  Meagher 
(1984)  where  the  treatment  efficiency  was  improved  by  more  than  50%  and 
in  Wells  (1978)  where  filamentous  bulking  was  avoided  and  power  expenses 
for  dissolved  oxygen  control  were  lowered  by  18^. 

One  of  the  most  important  variables  in  the  activated  sludge  process 
is  the  dissolved  oxygen  (DO)  concentration.  DO  control  has  drawn  much 
attention  in  the  recent  years,  e.g.  Wells  (1978),  Olsson  et  al.  (1985), 
Kay  et  al.  (1985),  and  Fujimotto  et  al.  (1983).  Regulation  of  DO 
concentration  at  the  proper  level  suppresses  the  development  of 
filamentous  organisms  and  their  deleterious  effects  in  the  operation  of 
the  final  settler.  In  addition,  it  minimizes  power  costs.  The 
widespread  application  of  DO  control  today  has  been  facilitated  by  the 
development  of  reliable  DO  measurement  probes. 
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The  past  unavailability  of  reliable  sensors  for  measuring  other 
process  variables,  e.g.  the  concentration  of  the  active  biomass  or  the 
BOD  in  the  influent  and  in  the  effluent  streams,  hindered  the  development 
of  effective  control  schemes  for  the  effluent  quality.  As  a result  most 
of  the  schemes  in  practice  today  for  such  control  use  implicit 
measurements  of  the  biological  activity,  or  of  the  incoming  load.  For 
example  Olsson  and  Andrews  (1978)  use  the  DO  profile  for  estimating  the 
organic  loading,  while  Holmberg  (1982)  employs  a state  estimator  based  on 
DO  and  aeration  rate  observations. 

Long  term  objectives,  such  as  solids  inventory  maintenance,  are 
easily  achieved  through  the  use  of  implicit  measurements  as  described 
above.  The  more  challenging  objectives  of  minimizing  both  the 
pollutional  load  of  the  effluent  stream  and  the  variation  of  the  effluent 
quality  require  more  sophisticated  measurement  and  control  equipment. 
With  the  advent  of  more  reliable  sensors  for  the  measurement  of  suspended 
solids  and  effluent  quality,  e.g.  COD,  TOC,  or  TOD,  control  schemes  can 
now  be  developed  which  compensate  for  diurnal  variations  in  a 
straightforward  and  more  effect  manner.  Mixed  liquor  suspended  solids 
(MLSS)  measurement  devices  are  currently  in  use  in  many  plants  (Flanagan 
(1978),  Wells  (1978))  with  very  successful  results.  On-line  TOC  and  TOD 
analyzers  have  been  recently  introduced  and  successfully  tested  in 
practice  (e.g.  Stephenson  et  al.  (1981),  Tiemon  and  Wagner  (1981)). 

The  estimation  or  measurement  of  the  effluent  quality  permits  direct 
assessment  of  the  activated  sludge  process  performance,  in  the  case  of 
large  diurnal  variations.  Optimal  control  has  been  proposed  by  Cook  and 
Marsili-Libelli  (1981),  and  optimal  periodic  control  by  Sincic  and  Bailey 
(1978),  and  Yeung  et  al.  (1980).  If  there  is  adequate  sludge  storage. 
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these  methods  result  in  excellent  treatment  performance.  Their  major 
disadvantage  is  that  they  require  the  use  of  complicated  nonlinear 
dynamic  models  with  a large  number  of  parameters  which  are  very  difficult 
to  identify  either  off-line  or  on-line. 

In  this  work  simple  linear  and  bilinear  dynamic  models  will  be  used 
for  the  optimal  control  of  the  activated  sludge  process.  The  advantage 
of  linear  models  lies  in  their  simplicity,  ease  of  identification  and 
flexibility  in  controller  design.  Since  the  process  is  characterized  by 
time  varying  gains,  time  constants  and  parameters,  the  linear  model  is 
continuously  identified  on-line  and  adaptive  control  methods  are  employed 
for  controller  design. 

Sincic  and  Bailey  (1978)  have  determined  that  for  physically 
realistic  bounds  on  the  control  variable,  the  optimal  control  policy  with 
respect  to  the  effluent  quality  and  variability  is  essentially  bang-bang. 

For  these  reasons,  an  optimal  adaptive  bang-bang  controller  is 
developed  in  this  chapter  which  minimizes  the  performance  measure  that 
was  introduced  by  Sincic  and  Bailey  (1978).  At  the  same  time  adaptive  DO 
control  is  also  implemented  and  the  effectiveness  of  the  proposed  control 
strategies  is  illustrated  by  simulations  with  a simple  process  model. 

Process  Description  - Model  for  Simulation 

The  activated  sludge  process  is  schematically  represented  in  Figure 
7-1.  In  the  aeration  basin  organic  matter  from  the  influent  stream  comes 
into  contact  with  aerobic  biological  matter  (activated  sludge)  and  is 
oxidized  to  cell  mass,  carbon  dioxide  and  water.  The  aerobic  conditions 
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are  maintained  by  continuous  aeration  of  the  basin.  The  activated  sludge 
is  separated  from  the  liquid  phase  in  the  final  sedimentation  tank  and  is 
partly  recycled  to  the  aeration  basin  in  concentrated  form.  A portion  of 
the  sludge  is  wasted  from  the  bottom  of  the  sedimentation  tank. 

Aeration  Basin 


There  are  two  major  modeling  approaches  for  the  activated  sludge 
process.  The  simpler  one  considers  two  aggregated  state  variables:  the 
concentration  of  the  growth  limiting  organic  substrate  (s)  and  the 
concentration  of  the  viable  or  active  biomass  (x),  e.g.  Andrews  (1971), 
Sincic  and  Bailey  (1978).  A better  representation  of  the  dynamic 
behavior  of  the  process  is  obtained  by  structuring  the  substrate  and  the 
biomass  into  several  components,  e.g.  Busby  and  Andrews  (1975),  Nelson 
and  Lawrence  (1980),  and  Curds  (1971,  1973).  Although  these  models  are 
closer  to  reality  than  the  aggregated  ones,  they  usually  result  in  a 
large  number  of  differential  equations  which  are  difficult  to  verify 
experimentally. 

In  this  work,  for  the  sake  of  simplicity,  the  algorithm  will  be 
tested  with  an  aggregated  variables  model  simulating  the  process.  The 
aeration  basin  is  modeled  as  an  ideal  continuous  flow  stirred  tank 
reactor.  In  addition,  the  following  further  simplifying  assumption  are 
made:  i)  the  microorganism  concentration  in  the  influent  stream  is  zero, 
ii)  the  substrate  concentration  in  the  return  activated  sludge  stream  is 
equal  to  the  substrate  concentration  in  the  aeration  basin.  Under  the 
assumptions  the  aeration  basin  dynamics  are  described  by  the  following 
equations: 
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= - — s - _ y(s,c)x 

dt'  V V Y 


(7-1) 


dx  (^o 


dt'  V 


+ y(s,c)  X - k(jx 


(7-2) 


V 


U(s,c) 


^max  ^ 


(7-2) 


k.g  + s k^,  + c 


where  y(s,c)  is  the  biomass  specific  growth  rate,  and  the  notation  for 
the  rest  of  the  variables  is  given  in  Table  7-2  at  the  end  of  the 
chapter.  Here  the  biomass  specific  growth  rate  follows  Monod  kinetics 
with  double  substrate  limitation  by  both  the  substrate  concentration  s 
and  the  dissolved  oxygen  concentration  c. 

These  two  differential  equations  for  the  aeration  basin  describe  the 
process  sufficiently  well  for  the  needs  of  this  work. 

Sedimentation  Tank 

The  sedimentation  tank  accomplices  two  important  tasks.  As  a 
"clarifier"  it  separates  the  activated  sludge  from  the  treated  water.  As 
a "thickener"  it  concentrates  the  biological  solids  which  are  recycled 
and  serves  as  a sludge  storage  reservoir.  The  performance  of  the 
activated  sludge  process  crucially  depends  on  the  efficiency  of  both 
functions.  If  the  sludge  has  poor  settling  properties  or  the  clarifier 
cannot  accommodate  incoming  loads,  the  solids  are  carried  away  with  the 
supernatant  water  and  increase  the  BOD  in  the  effluent  stream.  If,  on 
the  other  hand,  the  recycled  sludge  is  not  concentrated  enough,  then  it 
may  not  be  possible  to  recycle  the  amount  of  solids  required  to 
compensate  for  large  incoming  loads. 
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A sludge  mass  balance  around  the  final  sedimentation  tank  gives 

dM^. 

= (Fo  + ^r)  ^ - ^r^r  " (^o  ~ ^w)  ~ 

dt' 

where  is  the  total  mass  of  solids  in  the  tank. 

In  order  to  completely  describe  the  dynamic  behavior  of  the 
thickener  we  need  to  know  the  concentration  profile  in  the  thickening 
volume  and  the  effluent  solids  concentration.  Partial  differential 
equations  and  the  "limiting  flux  theory"  have  been  employed  to  describe 
dynamically  the  thickening  and  clarifying  functions,  e.g.  Tracy  and 
Keinath  (1973),  George  and  Keinath  (1978).  Empirical  steady-state 
equations  for  the  effluent  solids  concentration  have  been  used  by  (e.g. 
Pflanz  (1969),  Ghobrial  (1978)).  The  validity  of  both  approaches  is 
limited  and  in  general  the  dynamic  phenomena  associated  with  the 
sedimentation  tank  are  poorly  understood. 

In  this  work  the  dynamic  behavior  of  the  clarifier  is  treated  in  a 
qualitative  way.  Two  extremes  in  clarifier  performance  are  considered 
with  the  actual  process  lying  somewhere  in  between.  If  the  sedimentation 
tank  is  small  enough,  its  dynamics  are  much  faster  than  the  dynamics  of 
the  aeration  basin  and  the  pseudosteady-state  hypothesis  is  approximately 
valid.  In  this  case  the  return  activated  sludge  concentration  is  given 
by 


(^0  + Fp)  X (Fq  Fy)  Xg 


Xr  = 


Fr  + Fw 


(7-5) 
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Pflanz  (1969)  gives  the  following  empirical  relation  for  the  effluent 
solids  concentration  xg 


xg  = Kp(Fo  + F^)  X (7-6) 

We  henceforth  refer  to  this  as  the  "fast"  settler  case. 

At  the  other  extreme,  we  consider  a large  sedimentation  tank  which 
provides  for  sludge  storage  volume  and  is  practically  insensitive  to  any 
changes  in  the  influent  or  recycle  flowrates.  In  this  case  the  return 
sludge  concentration  is  characterized  by  very  slow  dynamics  and  for  all 
practical  purposes  can  be  assumed  constant,  i.e. 


Xr(t)  = (7-7) 

In  the  sequel  this  will  be  referred  to  as  the  "slow"  settler  case. 

It  has  been  recently  realized  that  successful  application  of  control 
policies  aiming  at  the  improvement  of  performance  with  respect  to  diurnal 
variations  requires  a large  storage  volume  for  concentrated  sludge.  This 
volume  can  be  incorporated  in  the  final  sedimentation  tank  by  increasing 
its  size  (Flanagan  (1978))  or  it  can  be  provided  by  an  external  sludge 
reservoir.  Such  modifications  have  been  discussed  by  Nogita  and  Hiraoka 
(1981),  Nogita  et  al.  (1981),  and  Lohmann  and  Schlegel  (1981). 

Dissolved  Oxygen  Dynamics 

The  oxygen  mass  transfer  and  utilization  are  the  best  understood 
phenomena  in  the  activated  sludge  process.  Oxygen  is  used  by  the 
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microorganisms  for  respiration  during  biomass  synthesis  and  endogenous 
metabolism.  The  consumed  oxygen  is  replaced  through  strong  aeration  of 
the  reacting  volume.  The  DO  mass  balance  is  given  by  the  following 
differential  equation: 

dc  Fq  + 

= - c + KLa(c®  - c)  - OUR  (7-8) 


OUR  . pip(s,c)  X + P2X  (7-9) 

In  developing  this  equation  it  is  assumed  that  the  influent  and  recycle 
streams  carry  a negligible  amount  of  dissolved  oxygen.  The  parameter  Kls 
represents  the  oxygen  mass  transfer  coefficient  and  is  assumed  to  be  a 
linear  function  of  the  air  flow  rate  F^ 


^La  = P3  + P4^a  (7-10) 

The  last  term  in  (7-8)  represents  the  oxygen  utilization  rate  for  both 
biosynthesis  and  biodegradation.  The  OUR  is  one  of  the  most  important 
variables  in  many  control  approaches  since  it  is  closely  related  to  the 
biological  activity  inside  the  aeration  basin. 

Control  Objectives  and  Algorithms 

The  adaptive  control  algorithms  developed  in  this  chapter  aim  at  two 
control  objectives.  First,  the  quality  of  the  effluent  is  of  paramount 
importance.  In  particular,  it  is  desired  to  minimize  the  effects  of  the 
periodic  load  variations  on  the  quality  of  the  effluent  stream.  Second, 
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since  the  DO  concentration  in  the  aeration  basin  can  greatly  influence 
the  sludge  settling  characteristics  (e.g.  Lau  et  al.,  1984;  Fujimoto  and 
Aral,  1981),  it  is  essential  to  maintain  DO  within  a certain  range.  Use 
of  feedback  control  to  achieve  the  latter  objective  can  in  addition 
result  in  substantial  energy  savings  (e.g.  Speirs  and  Stephenson,  1981). 

The  effluent  quality  is  best  influenced  by  manipulation  of  the 
return  activated  sludge  (RAS),  and  the  DO  concentration  can  be  controlled 
through  the  aeration  rate  F-^.  Since  the  DO  control  loop  has  response 
time  of  the  order  of  minutes,  whereas  the  effluent  quality  loop  is  much 
slower  with  response  time  of  the  order  of  hours,  the  two  control  loops 
can  be  considered  independently. 

Effluent  Quality  Control 


A performance  measure  is  explicitly  formulated  and  a linear  dynamic 
model  is  utilized  to  design  a feedback/feedforward  adaptive  control  law 
which  minimizes  the  performance  measure.  The  approach  followed  here  was 
motivated  by  the  original  work  of  Sincic  and  Bailey  (1978)  and  Yeung  et 
al.  (1980). 

The  activated  sludge  process  performance  with  respect  to  the 
effluent  quality,  may  be  represented  by  the  following  performance 
measure: 


J(t') 


q t'+Tp  1 t'+T 

- I (Fo(T)-F„)y(T)dT  + _ ; (y(x)-yave)2dt 

Tn  t'  T„  t' 


(7-11) 


y(t')  = P5s(t')  + P6XE(t') 


(7-12) 
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where 

y(t')  is  a measurement  of  the  effluent  quality,  e.g.  TOC  or  TOD, 
accounting  for  both  filterable  substrate  (s)  and  solids  (xg) 

Tp  is  the  period  of  the  feed  variations,  typically  one  day 
and  q > 0 is  a weighing  coefficient. 

The  first  term  in  the  performance  measure  represents  the  daily  amount  of 
substrate  discharged  with  the  effluent  stream  and  the  second  term  the 
variation  of  the  effluent  quality  from  the  average  value  y^ye*  shown 
later  this  cam  be  chosen  as  either  the  mass  average  or  the  average  y.  To 
ensure  that  y^ye  within  acceptable  limits,  the  following  performance 
constraint  is  imposed: 


^ave  - ^max  (7-13) 

In  addition  there  are  constraints  imposed  by  the  process,  namely  the  RAS 
rate  must  be  restricted  between  two  values,  Pr,min  avoid  washout  of 
the  aeration  basin  and  Fr,max  avoid  depletion  of  the  clarifier 
blanket.  Sincic  and  Bailey  (1978)  showed  that  for  realistic  RAS  bounds 
the  optimal  controller  which  minimizes  (7-11)  is  bang-bang  (or  very 
nearly  so).  Using  this  fact,  the  optimization  task  is  made  easier  by 
restricting  the  search  to  the  optimal  bang-bang  controller. 

For  adaptive  control  the  parameters  of  a discrete  time  input-output 
model  (usually  linear)  are  continually  updated  on  line.  The  process 
output  is  the  effluent  quality  measurement  as  given  by  (7-12).  Process 
inputs  are  the  control  variable  Fr,  the  influent  flow  rate  Fq  and,  if 
measured  or  estimated,  the  influent  load  FqSq. 

A second  order  time  series  input-output  model  is  employed  to  desribe 
the  dynamic  behavior  of  the  process 


y(t+l)  = aoy(t)  + aiy(t-l)  + boU(t)  + b^uCt-l) 


(7-14) 


+ Cod(t)  + cid(t-l)  + eglCt)  + eil(t-l)  + r 


where 

t represents  time  in  number  of  sampling  periods 

y(t+l)  is  the  process  output 

u(t)  is  the  control  variable  F^(t) 

d(t)  is  the  influent  flowrate  FQ<t) 

l(t)  is  the  influent  load  FQSQ(t) 

cj,  ej^  (i=0,l)  and  r are  the  on-line  identified  model 
parameters. 

If  the  influent  load  is  not  measured,  it  can  be  excluded  form  the  model 
by  taking  eQ  = ej^  = 0. 

The  unknown  parameters  of  model  (7-14)  are  estimated  on-line  via  a 
recursive  least  squares  estimator  with  a variable  forgetting  factor 
(RLSVFF)  using  input  and  output  information  (Fortescue  et  al.,  1981). 

The  adaptive  optimal  bang-bang  control  problem  is  then  formulated  as 
follows: 

Minimize 


q N * - 1 N - 

Jo(t)  = Z (d(t+i)-Fy)y(t+i)  + _ Z (y(t+i)-y.„e)2  (7-15) 

N i=l  N i=l 


(which  results  from  the  discretization  of  performance  measure  (7-11)) 
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subject  to 


(i)  y(t+i)  = aQ(t)y(t+i-l)  + ai(t)y(t+i-2)  (7-16) 

+ bQ(t)u(t+i-l)  + b]^(t)u(t+i-2) 

+ CQ(t)d(t+i-l)  + C]^(t)d(t+i-2)  + r(t) 

A A A 

+ (eQ(t)l(t+i-l)  + e^(t)l(t+i-2))  for  i > 1 

y(t+i)  = y(t+i)  for  i = -1,0 

(ii)  Yave  ^ ^max  (7-17) 


over  all  possible  control  vectors 


i - 1 , . . . , M 

li  = [•••»  Ui(j),  ...]^  (7-18) 

j = t,  t+N-1 


where 

Ui(j)  is  either  or 

M is  the  number  of  all  possible  combinations  of  u^jjj  and  u,„gjj  to 
form  the  control  vector  vj,  i.e.  M = 2^. 

y(t+i)  denotes  the  prediction  of  the  output  at  time  t+i  using  the 
current  parameter  estimates  r(t),  aj(t),  bj(T),  (j=0,l). 

N = Tp/T  with  T being  the  sampling  period 
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' 1 N - 
- z y(t+i) 
N i=l 


^ave  “ 


or 


N 

E (d(t+i)-F^,)y(t+i) 
1=1 


N 

E (d(t+i)-FJ 
1=1 


(a) 


(b) 


(7-19) 


The  first  choice  accounts  for  the  variability  In  the  effluent 
concentration,  whereas  the  second  accounts  for  the  variability  of 
the  mass  averaged  effluent  concentration. 

Future  feed  variables  (d  and  i)  may  be  predicted  from  the  process 
operation  history.  Past  data  can  be  analyzed  with  the  aid  of  statistical 
methods  to  obtain  dally  average  Influent  profiles  or  to  forecast  future 
values.  Such  analyses  have  been  reported  by  Berthouex  et  al.  (1978)  and 
Debelak.  and  Sims  (1981).  The  simplest  but  probably  not  the  best  method 
Is  to  take  the  anticipated  feed  variables  equal  to  those  of  the  previous 
day  at  the  same  time. 

The  above  problem  Is  solved  comblnatorlally.  The  performance 
measure  JQ(t)  Is  computed  for  each  of  the  control  vectors  vj^.  The 
optimal  control  vector  v^p^  Is  the  one  correpondlng  to  the  minimum  value 
of  Jd(^)  which  does  not  violate  the  constraint  on  the  effluent  average 
(7-17). 

Because  the  estimator  parameters  are  updated  at  every  sampling 
Instant,  only  the  first  element  of  VQp|.(t),  Ugp^(t)  Is  Implemented.  At 
the  next  sampling  Interval  t + 1 the  minimization  Is  performed  again 
using  the  updated  model  parameters  and  the  current  Inputs  and  output. 
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The  sampling  period  T is  determined  by  the  process  dynamics,  the 
measurement  devices  and  the  feed  period.  The  fact  that  the  activated 
sludge  process  has  slow  dynamics  for  the  RAS  - effluent  quality  loop 
suggests  that  a large  sampling  period  is  appropriate  (typically  in  the 
range  1-4  hours).  Current  measurement  devices  for  TOC  or  TOD  can  easily 
accommodate  such  sampling  requirements. 

Given  the  large  sampling  period,  the  required  computations  are  a 
rather  simple  task  for  contemporary  control  computers.  For  example,  if  N 
= 8 (T  = 3 hours)  JpCt)  is  calculated  256  times.  This  task  can  be 
accomplished  in  seconds  by  most  microcomputers  available  today. 

One  final  remark  is  in  order.  If  the  control  stays  constant  for 
many  sampling  periods,  the  parameter  estimator  may  run  into  difficulties. 
To  avoid  this,  a small  amount  of  excitation  is  added  to  the  calculated 

'^opt  ^ ^ ^ * 

Dissolved  Oxygen  Control 

The  control  objective  for  the  DO  loop  is  to  maintain  the  dissolved 
oxygen  concentration  c(t)  at  the  desired  value  Cjj.  Adaptive  control  is 
the  natural  framework  for  this  loop  since  many  system  parameters  (e.g. 
OUR,  Kl^)  are  experiencing  relatively  slow  variations. 

Equation  (7-8)  suggests  that  a bilinear  model  can  be  used  to 
describe  the  DO  dynamics 


z(k+l)  = m2z(k)  + m2w(k)  + m3z(k)w(k)  + m^[d(k)  + u(k)]z(k)  + m5  (7-20) 
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where 

k represents  time  in  number  of  sampling  periods  Tj^  for  the  DO  loop 

(which  is  typically  3-10  minutes) 

z(k)  is  the  DO  measurement 

w(k)  is  the  aeration  rate 

mj^  i = 1,  4 are  model  parameters 

d(k),  u(k)  are  the  samples  of  Fq,  Fj.  at  time  k. 

As  in  the  case  of  effluent  quality  control  the  parameters  mj  are 
estimated  with  the  RLSVFF  estimator. 

A robust  adaptive  controller  is  desired  for  the  fast  DO  loop.  We 
shall  employ  the  cautious  self  tuning  controller  (CSTC)  developed  in 
Chapter  III,  which  is  based  on  the  following  performance  measure: 


Jqx  = [z(k+l)  - Cd]2  + Q(k)[w(k)  - w^,]2 


(7-21) 


where 


z(k+l)  is  the  output  prediction  at  time  k 


z(k+l)  = mj^(k)z(k)  + m£(k)w(k)  + m3(k)z(k)w(k) 


(7-22) 


+ m^(k)[d(k)+u(k)]z(k)  + m5(k) 


Wj,  is  a safe  control,  as  for  example  a constant  aeration  rate,  high 
enough  to  guarantee  sufficiently  high  DO  concentration  even  at  large 
loads. 
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Employing  similar  analysis  as  in  Chapter  III,  it  can  be  proved  that 
an  appropriate  weight  which  provides  robust  control  without  unnecessarily 
slowing  down  the  process  is 


h(k)[m2(k)  + m3(k)z(k)]2 

Q(k)  = 

1 - h(k) 

where 


(7-23) 


v(k) 

h(k)  = ^ . 

5|[m2(k)  + m3(k)z(k)]Wj.|  + v(k) 


(7-24) 


v(k)  - Xv(k-l)  + (1-X)|e(k)|  ; 0 < X < 1 (7-25) 

(v(k)  is  a filtered  estimation  error  e(k)) 


e(k)  = z(k)  - z(k)  (7-26) 

The  parameter  5 is  the  maximum  allowable  relative  error  in  the  control 
law  and  is  chosen  in  the  range  of  0.05-0.5. 

Minimization  of  (7-21)  with  respect  to  w(k)  results  in  the  following 
control  law: 


w(k)  = h(k)Wc  + [l-h(k)]w„v(k)  (7-27) 

where  Wj^y  is  the  dead-beat  controller  obtained  by  minimizing  Jqj^  with 
Q(k)  = 0.  This  control  law  sets 
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z(k+l)  = Cjj 


(7-28) 


i.e.  drives  the  output  to  the  set  point  at  the  shortest  possible  time. 


To  simulate  the  process,  the  model  of  (7-l)-(7-3),  (7-8)-(7-10)  was 
used  for  the  aeration  basin.  Both  the  "fast"  (7-5),  (7-6)  and  the  "slow" 
(7-7)  extremes  for  the  sedimentation  tank  were  considered.  The  model 
parameters  used  in  the  simulations  are  presented  in  Table  7.1 

The  inlet  flowrate  Fq  and  substrate  concentration  Sg  were  assumed  to 
be  approximately  periodic 


where  Fg,  ig  are  the  average  values  of  Fg,  Sg  and  the  coefficients  hp,  hg 
determine  the  amplitude  fo  the  oscillation.  White  noise  Nj^(t),  N£(t)  was 
added  to  simulate  day  to  day  variations.  The  Fg,  Sg  as  given  by  (7-29), 
(7-30)  are  shown  in  Figure  7-2. 

Equation  (7-19a)  was  used  for  y^ve  optimization  algorithm, 
and  the  maximum  allowable  average  was  set  at  15  mg/lt.  The  recycle 
flow  rate  is  bounded  between  the  u^j^g  and  given  in  Table  7-1.  The 
lower  and  upper  bounds  Fa,min»  ^a,max  aeration  flow  rate  are  also 
given  in  the  same  table. 


Simultation  Results 


Fo(^:)  = Fo(l+(hp  + Ni(t))sin(2jlt/Tp)) 


(7-29) 


Sg(t)  = Sg(l  + (hg  + N2(t))sin(2nt/Tp)) 


(7-30) 
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Testing  of  the  effluent  quality  control  algorithm  was  first 
undertaken  assuming  a constant  DO  concentration  of  2 mg/lt  in  the 
aeration  basin.  In  Figure  7-3  the  performance  of  the  optimal  bang-bang 
controller  is  shown  for  the  "slow"  settler  case  and  q = 0.  In  this  case 
only  the  effluent  variability  is  minimized  subject  to  the  constraint  (7- 
17).  The  average  effluent  concentration  is  found  to  be  12.5  mg/lt, 
whereas  the  average  value  of  the  performance  measure  is  calculated  to  be 
“^djave  “ mg/lt.  - 

In  order  to  study  the  effect  of  the  parameter  q in  the  performance 
measure  (7-15),  the  same  run  was  repeated  taking  q = 0.01.  As  seen  from 
Figure  7.4  the  average  y is  somewhat  lower  (9.3  mg/lt)  at  the  expense  of 
variability  (15.4  mg/lt  compared  to  8.2  mg/lt  for  the  previous  run). 

To  compare  the  effectiveness  of  the  proposed  control  algorithm  with 
that  of  standard  wastewater  treatment  control  practice,  the  performance 
of  ratio  control  was  evaluated.  For  comparison  purposes,  the  ratio  was 
chosen  so  as  to  achieve  the  same  y^yg  as  in  the  case  of  Figure  7-4.  The 
temporal  variation  of  the  effluent  quality  measurement  is  shown  in  Figure 
7-5.  In  this  case  the  average  variability  (27.11  mg/lt)  is  significantly 
higher  than  in  the  adaptive  bang-bang  case. 

However,  as  seen  in  Figures  7-6  and  7-7,  in  the  case  of  the  fast 
settler  model  the  improvement  with  adaptive  optimal  bang-bang  control  is 
only  marginal  (variabilitiy  51.8  mg/lt  versus  variability  61.0  mg/lt  for 
ratio  control  with  the  same  yave^’  With  realistic  settler  dynamics  an 
intermediate  performance  is  expected.  It  is  obvious  that  the  larger  the 
settler  size  is,  the  more  effective  can  control  action  be  in  compensating 
for  diurnal  variations. 
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In  order  to  test  the  performance  of  the  two  control  loops  combined, 
the  "slow"  settler  case  was  repeated  with  CSTC  DO  control.  As  seen  from 
Figure  7-8  the  DO  loop  operates  successfully  and  the  effluent  quality  is 
comparable  to  that  of  Figure  7-4. 
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TII-E 

Figure  7—2.  Influent  flowrate  Fq  and  substrate  concentration 
. Sq  versus  time  in  days. 
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Figure  7-3.  Effluent  substrate  concentration  s and  recycle 
flowrate  for  "slow" settler  dynamics  with 

adaptive  optimal  bang-bang  control  (q=0).  Per- 
fect DO  control  is  assumed. 
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Figure  7-4.  Effluent  substrate  concentration  s and  recycle 
flowrate  for  "slow"  settler  dynamics  with 
adaptive  optimal  bang-bang  control  (q=0.01). 
Perfect  DO  control  is  assumed. 
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Figure  7-5.  Effluent  substrate  concentration  s and  recycle 
flowrate  for  "slow"  settler  dynamics  with 

ratio  control  (r=0.7).  Perfect  DO  control  is 
assumed . 
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Figure  7-6.  Effluent  substrate  concentration  s and  recycle 
flowrate  for  "fast"  settler  dynamics  with 

adaptive  optimal  bang-bang  control  (q=0.01). 
Perfect  DO  control  is  assumed. 
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Effluent  substrate  concentration  s and  recycle 
flowrate  for  "fast"  settler  dynamics  with 

ratio  control  (r=0.35).  Perfect  DO  control  is 
assumed . 


Figure  7-7. 
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Figure  7 8.  Effluent  substrate  concentration  s and  recycle 
flowrate  for  "slow”  settler  dynamics  with 
cautious  self-tuning  control  of  DO  and  adaptive 
optimal  bang-bang  control  for  effluent  quality 
(q=0.01). 
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Figure  7-9.  DO  concentration  and  aeration  flowrate  F for 

"slow"  settler  dynamics  with  cautious  self- 
tuning control  of  DO  and  adaptive  optimal  bang- 
bang  control  for  effluent  quality  (q=0.01). 
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Table  7-1 
Parameter  Values 

Aeration  Basin 
c®  =9  mg/lt 
Fq  = 0.111  m^/sec 

Fy  » 2.444x10”^  m^/sec 

hp  = 0.5 

hg  = 0.2 

Kj,  = 5x10“^  mg/lt 

Kj  . 1.389x10-6  sec-1 

Kg  = 140  mg/lt 

Umax  = 5.7x10-^  sec-1 
N 3.  8 

Ni(t)  = white  noise  sequence  with  variance  1 

N2(t)  = white  noise  sequence  with  variance  1 

Pi  = 1 

P2  = 0.9 

P3  = 0 

P4  = 0.1 

P5  = 1 

P6  = 0 

Sq  =5  mg/lt 

T = 3 hr  (108000  sec) 

Tj^  =0.1  hr  (360  sec) 

Tp  = 8.64x10^  sec  (1  day) 

^max  = 0.111  m^/sec 
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Table  7-1  - continued 

Ujnin  = 2.778x10“^  m^/sec 

V = 2500  m3 

Y = 0.4 

Ymax  “ ^3  mg/lt 

Sedimentation  Tank. 

A = 300  m2 

Kp  » 4.32  sec/m 

Xj.  = 6500  mg/lt 

CSTC  Parameters 
=2  mg/lt 

Fa, max  “ 4.167xl0“2  m3/sec 
^a,min  “ m3/sec 

= 2.778x10“2  m3/sec 
S = 0.2 


X 


0.95 


Table  7-2 


Notation 

: sedimentation  tank,  cross  section  area 
: model  (7-14)  parameters 
; model  (7-14)  parameters 
: dissolved  oxygen  concentration 
: saturated  dissolved  oxygen  concentration 
: model  (7-14)  parameters 
: dissolved  oxygen  concentration  set  point 
: influent  flow  rate  Fg(t),  sampled  at  time  t 
; identified  model  parameters 
: aeration  flow  rate 
: influent  flow  rate 
: recycle  flow  rate 
: waste  stream  flow  rate 
: CSTC  control  law  weight 
: parameter  in  equation  (7-28) 

: parameter  in  equation  (7-29) 

: performance  measure 

: time  in  number  of  sampling  periods  in  the  DO 
control  loop 

: saturation  constant  for  oxygen  Monod  expression 
: microorganism  decay  coefficent 
; overall  oxygen  mass  transfer  coefficient 
: portionality  coefficient  in  equation  (7-6) 

: saturation  constant  for  substrate  Monod  expression 
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Table  7-2  - continued 

l(t) 

FqSq  the  influent  waste  load 

Me 

solids  mass  in  the  sedimentation  tank 

“i 

model  (7-20)  parameters 

N 

number  of  sampling  intervals  in  influent  period 

Ni(T) 

white  noise  sequence 

Pi 

constant  parameters  in  equations  (7-9),  (7-10),  (7-12) 

q 

performance  index  weight  in  equations  (7-11),  (7-15) 

Q(k) 

performance  index  weight  in  equation  (7-21) 

r 

model  (7-14)  parameter 

s 

substrate  concentration  in  the  aeration  basin 

So 

influent  substrate  concentration 

t 

time  in  number  of  sampling  intervals  for  the 
effluent-RAS  loop 

t' 

continuous  time 

T 

sampling  period  for  the  effluent  quality  loop 

Tie 

sampling  period  of  the  DO  loop 

T 

P 

period  of  influent  variations 

u(t) 

return  activated  sludge  (RAS)  flow  rate 

%in 

lower  bound  of  RAS 

^max 

upper  bound  of  RAS 

optimal  control  law  at  time  t 

V 

aeration  basin  volume 

Vi 

control  vector 

Vopt 

optimal  control  vector 

We 

"safe"  aeration  rate 

146 


Table  7-2  - continued 


w(k) 

X 


xe 

Xr 

Vave 

ymax 

y(t) 

Y 

z(k) 


: aeration  rate 

: active  biomass  concentration  in  the  aeration  basin 

: active  biomass  in  the  effluent  stream 

: active  biomass  concentration  in  the  recycled  stream 

: average  effluent  quality  over  a period 

: maximum  allowable  y 

: measurement  of  the  effluent  quality 

: growth  yield  factor 

: sampled  dissolved  oxygen  concentration 


^‘max 

V 

8 

X 

e 


Greek  Letters 
: maximum  growth  rate 
: filtered  estimation  error 
: CSTC  design  parameter 
; CSTC  filter  parameter 
: estimation  error 


0 

r 

E 

ave 

max 

min 


Subscripts 
: denotes  influent  variable 
! denotes  recycle  variables 
: denotes  effluent  stream  variables 
: denotes  average  values 
: denotes  maximum  values 
: denotes  minimum  values 


CHAPTER  VIII 
SUMMARY  AND  CONCLUSIONS 


Adaptive  controllers  based  on  linear  models  face  several  problems 
when  applied  to  highly  nonlinear  systems,  as  for  example,  large  sustained 
oscillations,  failure  in  set-point  tracking,  or  even  instability.  Three 
control  methods  have  been  developed  here  for  the  adaptive  control  of 
processes  which  considerably  deviate  from  the  linear  behavior. 

The  first  controller  is  a modification  of  well  known  self-tuning 
control  algorithms  and  is  called  the  "stabilizing”  STC.  This  is  a 
bounded  "standard"  STC  if  the  magnitude  of  both  the  estimation  and 
tracking  error  are  small,  and  switches  to  a robust  conservatively  tuned 
internal  model  controller  if  one  of  the  magnitudes  become  large.  Under 
the  modified  algorithm,  simulations  with  a nonlinear  system  show  that  the 
closed-loop  system  remains  stable  for  much  larger  set-point  and  load 
changes,  than  it  does  under  "standard"  self-tuning  control. 

The  second  controller  called  cautious  self-tuning  controller  links  a 
conservative  robust  control  law  and  the  minimum  variance  control  law, 
which  is  a controller  resulting  to  fast  closed-loop  dynamics.  The  CSTC 
adjusts  the  weighing  between  its  two  parts,  giving  conservative  control 
when  the  parameter  estimates  are  poor,  but  speeding  up  system  response  as 
the  estimates  improve.  Although  it  requires  a low  amount  of  modeling 
information  it  performs  well  for  both  servo-tracking  and  regulation,  even 
in  the  presence  of  strong  nonlinearities.  The  algorithm  resolves 
effectively  the  weight  selection  problem  often  encountered  in  one-step 
ahead  optimal  quadratic  control  applications.  The  computational 
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requirements  are  minimal,  only  slightly  higher  than  those  of  the  minimum 
variance  STR.  These  features  make  CSTC  an  attractive  alternative  for  the 
control  of  chemical  plants,  which  are  nonlinear  and  for  which  reliable 
dynamic  models  do  not  generally  exist. 

The  above  control  methods  can  be  applied  only  to  minimum  phase  and 
open-loop  stable  systems.  For  nonminimum  phase  and/or  open-loop  unstable 
systems  the  model  dependent  controller  is  presented.  MDC  is  a powerful 
design  method  which  treats  effectively  instability,  inverse  response  and 
time  delays.  It  can  handle  independently  set-point  tracking  and 
disturbance  rejection  assigning  different  closed-loop  dynamics  to  each  of 
them.  This  is  achieved  through  two  tuning  parameters  f and  r that 
specify  the  location  of  the  closed-loop  poles.  In  case  of  model 
uncertainty  the  same  parameters  directly  adjust  the  tradeoff  between 
robustness  and  speed  of  response.  Given  uncertainty  bounds  as  a function 
of  frequency  a robust  MDC  controller  can  be  designed  even  if  the  system 
is  open-loop  unstable.  If  no  uncertainty  bounds  are  known  and  the  system 
is  open-loop  stable  then  high  enough  f and  r ensure  closed-loop 
stability. 

Two  adaptive  versions  of  the  MDC  law  have  been  developed  and  they 
constitute  the  third  method  for  the  adaptive  control  of  nonlinear 
processes.  Stability  and  convergence  of  both  algorithms  have  been 
established  for  linear  time-invariant  systems.  The  flexibility  of  the 
MDC  design  method  in  adjusting  the  tradeoff  between  robustness  and 
performance  is  demonstrated  through  simulations  on  a typical  chemical 
process.  A method  for  adjusting  automatically  this  tradeoff  based  on  the 
plant/raodel  mismatch  has  been  presented  and  shown  to  be  effective  in 
controlling  the  nonlinear  chemical  process  mentioned  above. 
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Finally,  an  adaptive  controller  specifically  designed  for  the 
activated  sludge  process  for  wastewater  treatment  has  been  developed. 
Controller  design  for  the  activated  sludge  process  is  complicated  not 
only  because  the  process  is  nonlinear  but  in  addition  because  the 
flowrate  and  concentration  of  the  influent  waste  are  varying  periodically 
with  period  of  one  day.  The  periodically  of  the  inputs  causes  serious 
operational  problems,  the  most  serious  being  that  the  effluent  quality 
may  not  meet  the  environmental  standards.  The  adaptive  controller 
presented  here  is  of  the  bang-bang  form  and  minimizes  a process 
performance  index  which  includes  two  different  measures  of  the  effluent 
quality:  the  average  waste  concentration  at  the  effluent  stream  and  its 
variance  over  a period.  Numerical  simulations  have  shown  that  the 
developed  adaptive  bang-bang  controller  outperforms  conventional  control 
strategies,  and  that  there  is  a clear  tradeoff  between  the  two  measures 
of  the  effluent  quality.  Low  average  concentrations  can  be  achieved  at 
the  expense  of  effluent  variance. 

For  the  activated  sludge  process  dissolved  oxygen  control  has  been 
also  successfully  carried  out  using  the  CSTC  extended  to  bilinear 
systems.  Numerical  simulations  have  verified  that  effluent  quality 
control  and  DO  control  can  be  carried  out  simultaneously  and 
independently. 


APPENDIX  A 

INTERNAL  MODEL  CONTROL 


Controller 


Consider  the  z-domain  representation  of  a linear  single-input 
single-output  (SISO)  discrete  system 


where  Y(z),  U(z),  D^Cz)  are  the  z-transforms  of  the  output  y(t),  the 
control  variable  u(t)  and  the  ith  disturbance  d^Ct);  Gq(z)  and  G^j^Cz)  are 
the  system  transfer  functions  with  respect  to  the  control  and  the  ith 
disturbance  variable. 

According  to  the  IMC  methodology  the  classical  feedback  structure  of 
Figure  A-1  is  recast  into  the  IMC  structure  of  Figure  A-2.  The  two 
structures  are  equivalent  provided  that 


r 


(A-1) 


G, 


c 


1+Gc  G 


(A-2) 


or 


(A-3) 


where  G is  the  nominal  system  model. 
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Figure  A-1 . The  classical  feedback  structure. 
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Figure  A-2.  The  internal  model  control  (IMC)  structure. 
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In  IMC  the  controller  design  is  carried  out  through  Gj  and  the 
implemented  controller  transfer  function  is  then  obtained  from  (A-3). 
The  model  G is  factored  as 

G(z)  = G_(z)  G^(z) 

where  G^(z)  contains  all  the  non-invertible  elements  of  G (e.g.  time 
delays  and  zeroes  outside  the  unit  circle).  Gj(z)  is  then  chosen  as  an 
approximate  model  Inverse 

Gi(z)  = G_-l(z)  F(z)  (A-4) 

where  the  "filter"  F(z)  introduces  extra  dynamics  as  for  example  low  pass 
filtering  to  increase  robustness. 

From  (A-3)  the  controller  transfer  function  is  given  then  by 

F(z) 

Gc(z)  = (A-5) 

G_(z)  [l-G+(z)F(z)l 

If  the  model  is  perfect  (G  = Gq  the  IMC  closed-loop  equation  is 

r 

Y(z)  = F^(z)  Ysp(z)  + [l-F^(z)]  E GjiCz)  D^(z)  (A-6) 

i=l 


where 


F+(z)  = G^(z)  F(z) 


and  Ygp(z)  is  the  set-point. 
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It  is  seen  from  (A-6)  that  the  closed-loop  poles  for  set-point 
changes  involve  only  the  filter  poles.  To  eliminate  offset,  the  filter 
steady-state  gain  should  satisfy. 

F+(l)  = G^(l)  F(l)  = 1 

Since  (A-5)  involves  as  zeroes  the  open-loop  poles  of  (A-1),  poles-zero 
cancellations  occur  in  closed-loop.  For  this  reason  the  IMC  methodology 
is  applicable  only  to  open-loop  stable  systems. 

Another  drawback  of  IMC  can  be  seen  from  (A-6).  The  disturbance 
term  includes  the  filter  poles  in  addition  to  the  disturbance  transfer 
function  poles.  If  one  of  the  latter  poles  is  close  to  the  unit  circle 
the  disturbance  rejection  will  be  slow. 

Filter  Design 


Let  F(z)  be  factored  as 
F(z)  = Fi(z)  F2(z) 
and  Fj^(z)  is  chosen  to  satisfy 

|G^(z)  Fi(z)|  = 1 for  |z|  = 1 


(A-7) 


(A-8) 


with  pole(s)  inside  the  unit  circle. 

Note  that  if  G(z)  has  no  zeroes  outside  the  unit  circle,  then 
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G^.(z)  = z ^ 


where  k is  the  model  time  delay.  In  this  case 


|G+(z)|  = 1 and  we  take  = 1. 

If  G(z)  involves  zeroes  outside  the  unit  circle,  then 
m 

G^.(z)  = z-*^  n (1-Zi+z-l) 

where  zj'*'  is  a zero  of  G(z)  outside  the  unit  circle.  Equation  (A-8)  is 
satisfied  if 

m 1 

Fi(z)  * n (A-9) 

i=l  -zj"*"  + z 

G+(z)  Fj^(z)  form  what  is  called  a Blaschke  product  or  an  "allpass"  filter 
(Zames  and  Francis,  1983). 

The  usual  choise  for  F2(z)  is 


1-f 

F2<z)  = ^ 0 < f < 1 

1-fz-l 


Combining  (A-9)  and  (A-10)  the  filter  is 


(A-10) 


F(z) 


1-f  m 1 

^ n 

l-fz“^  i=l  -zj'*'  + z“^ 


(A-11) 
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Note  that  the  above  selection  of  F(z)  results  to 
|F^(z)|  = |F2(z)|  for  |z|  = 1 


and 


F+(l)  = 1 


Robustness  of  IMC 


Assume  that  the  nominal  model  is  not  perfect,  i.e.  G ^ Gq.  Let 
AG(z)  = Gq(z)  - G(z) 

represent  the  plant/model  mismatch  (or  the  model  uncertainty).  The 
closed-loop  equations  resulting  from  (A-1)  and  (A-5)  are 


T(z)  Y(z)  = Gq(z)  F(z)  Yd(z)  + (A-12) 

r 

+ G_(z)  (1  - G^(z)  F(z))  Z Gjji(z)  Di(z) 

i=l 

r 

T(z)  U(z)  = F(z)  Yd(z)  - F(z)  Z Gji(z)  Di(z) 

i=l 

where 


T(z)  = G_(z)  + AG(z)  F(z)  (A-13) 

The  closed-loop  system  is  stable  if  all  zeroes  of  T(z)  lie  inside  the 
unit  circle. 
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It  is  shown  in  Garcia  and  Morari  (1985)  that  it  is  possible  to  find 
a filter  F(z)  depending  on  some  uncertainty  bounds  that  stabilizes  the 
closed-loop  system.  A simpler  way  for  proving  this  follows. 

Rewrite  (A-13)  as 

T(z)  = G_(z)  Ti(z) 


where 


AG(z) 

Tl(z)  = 1 + F(z)  (A-14) 

G_(z) 


Since  G_(z)  is  Invertible  (by  construction)  all  of  its  zeroes  are  inside 
the  unit  circle.  The  prove  stability  it  remains  to  show  that  the  zeroes 
of  T]^(z)  also  lie  in  the  unit  circle. 

Define  the  relative  uncertainty  as 


_ ^(z) 

^(Z)  = (A-15) 

G(z) 


Then,  from  (A-14)  we  obtain 


Ti(z)  = 1 + AG  (z)  G^(z)  F(z)  or 

Ti(z)  = 1 + ^(z)  F^(z)  (A-16) 

The  Nyquist  criterion  for  stability  is  satisfied  if 


l^(z)l  |F+(z)|<l  for  z = ej“  0 < w < n 
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Assume  that  an  upper  bound  is  known  for  AG(z),  i.e. 


I^(z)|  < p (co)  at  z = ej“ 

Then,  a sufficient  condition  for  stability  is 


1 

|F^(z)|  < at  z = e-^“ 

p(») 


or  using  (A-11) 


(A-17) 


|F2<z)I 


1-f 

l-fz~^ 


1 

< 

p(w) 


at  z 


ej» 


(A-18) 


It  is  seen  from  (A-18)  that  if  uncertainty  bounds  are  known  it  is 
possible  to  find  an  f that  satisfies  (A-18). 

Here,  it  will  be  shown  formally  that  such  an  f exists  if  a mild 
condition  for  the  steady-state  gain  is  satisfied. 


Theorem  A.l 


If  the  steady-state  gain  sign  is  known,  i.e.  Gq(1)  G(1)  > 0,  there 
exists  f„,in  (0<fmin<l)  such  that  for  any  f (0<f<l)  the  closed-loop 
system  is  stable. 

Proof « Substitute  z = ej“  = cosw  + jsinco  in  (A-10).  Then 
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|F2(ej“)l  = ^ ^ 

(l+f^-2fcosw)^' ^ 

and  the  stability  condition  (A-18)  becomes 

1-f  1 

(l+f^-2fcosto)^'^^  p(») 

which  is  equivalent  to 


F(f;»)  = (l+f2-2fcosw)  - p2(w)(l-f)2  >0  0 < « < H (A-20) 

Consider  F(f;a>)  as  a binomial  in  f with  w being  a parameter  taking  values 
in  [0,ii]. 

Note  that 


F(l;»)  = 2(l-cos»)  >0  V w (0,n]  (A-21) 


Let  f*(w)  be  the  maximum  real  root  of  F(f*;a>)  = 0 in  [0,1).  If  no 
such  root  exists  take  f*(w)  = 0.  Then 


F(f;w)  > 0 


V f f*(w)  < f < 1 
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If  we  choose 


fmin  = •nax  [f*(ft))]  0 < w < II 

0) 


then 


F(f;w)  >0  V f < f < 1 

V w 0 < w < II 

It  remains  to  show  that  (A-20)  is  true  also  for  « = 0. 

From  (A-20) 

F(f;0)  . (l-f)2  (l-p2(0))  > 0 

which  is  true  if  p(0)  < 1.  Condition  p(0)  < 1 implies  that  0 < 

Go(l)/G(l)  < 2 which  may  be  very  restrictive  in  many  cases.  If  the 
system  is  linear,  p(0)  < 1 is  a reasonable  assumption  (usually  p(0)  ~ 0, 
no  steady-state  error).  But  if  the  system  is  non-linear  the  steadiy- 
state  gain  is  varying  with  the  operating  conditions.  In  this  case  the 
condition  p(0)  < 1 can  be  easily  violated. 

In  the  following  we  shall  try  to  remove  this  condition.  Recall  that 
the  sufficient  condition  for  robust  stability  is 


I ^(2)1  I F^(Z)|  <1  for  Z = ej“ 


0 < 0)  < n 
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Imposing  this  condition  we  restrict  the  Nyquist  diagram  of  F^(z) 
inside  a circle  of  radius  one. 

This  way  we  ensure  that  for  any  frequency  w the  point  (-l,jQ  ) is 
not  encircled.  The  condition's  conservativeness  can  be  removed  at  the 
zero  frequency  limit  if  we  ensure  that  the  Nyquist  diagram  starts  for  co  = 
0 at  a point  to  the  right  of  (-1,  jO),  i.e. 


/^(l)  F^(l)  > -1  or 


God) 

> 0 

G(l) 


Then  (A-20)  is  valid  for  any  f belonging  to  (fniin»  ^)»  q*e.d. 


Asymptotic  Propery  of  IMG 

If  the  closed  loop  system  is  stable  and  the  inputs  are 
asymptotically  constant  (set-point  and  disturbances),  IMG  eliminates 
offset.  This  is  obvious  from  (A-12)  and  the  fact  that  F^(l)  = 1. 


APPENDIX  B 

RECURSIVE  LEAST  SQUARES  ESTIMATOR 
The  Least  Squares  Estimator 

Consider  the  following  description  of  a dynamical  system: 

y(t)  = xT(t-l)0  + ^(t-1)  (B-1) 

where  y(t)  is  a measured  variable,  x(t-l)  is  the  information  vector  and 
is  known,  6 is  a set  of  unknown  parameters  and  ^(t-1)  is  an  unknown 
sequence  describing  deviations  from  the  linear  deterministic  dynamic 
behavior. 

The  least  squares  algorithm  minimizes  the  following  cost  function: 
t 

J^O)  = Z [y(i)  - xT(i-l)0]2  + (0-00)'*^  Pq"^  (Q-en)  (B-2) 

i=l 

where 

'^i,t  = cTi,t-l  \nin  < Mt)  < 1 (B-3) 

*^i,i  = 0 < a(i)  < ® 

is  a sequence  of  nonnegative  weighing  coefficients,  0q  and  Fq  are  apriori 
parameter  estimates  and  the  corresponding  covariance  matrix. 

The  estimate  0(t)  minimizing  (B-2)  at  each  time  t is  given  by  the 
following  recursive  algorithm. 
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e(t)  = e(t-i)  + a(t)  K(t-i)  E(t) 


P(t-l)  x(t-l) 

K(t-l)  = 

X(t)  + a(t)  w(t-l) 


e(t)  = y(t)  - y(t) 


(B-4.1) 


(B-4.2) 


(B-4.3) 


y(t)  = xT(t-l)  0(t-l)  (B-4.4) 

1 a(t)  P(t-l)  x(t-l)  xT(t-l)  P(t-l) 

P(t)  = [P(t-l)  - ] (B-4.5) 

X(t)  X(t)  + a(t)  w(t-l) 

w(t-l)  = xT(t-l)  P(t-l)  x(t-l)  (B-4.6) 

where  P(t)  is  the  covariance  matrix  and  e(t)  is  the  apriori  prediciton 
error. 

The  algorithm  is  initialized  with  9(0)  = Gq  and  P(0)  = Pq.  The 

forgetting  factor  used  in  this  work  is  described  in  section  B.3. 

Estimator  Properties 


Estimator  Convergence 


Define  the  Lyapunov  function 


V(t)  = 9^(t)  P-l(t)  9(t)  > 0 


(B-5) 


L64 


where 


0(t)  = e - 0(t)  (b_6) 


It  can  be  proved  from  equations  (B-4)  that  V(t)  satisfies 


X(t)  e2(t) 

V(t)  = X(t)  V(t-l)  - a(t)  + a(t)  (B-7) 

X(t)  + a(t)  w(t-l) 


and  since  X(t)  < 1, 


X(t)  e2(t) 

V(t)  < V(t-l)  - a(t)  + a(t)  ^2(t_i)  (b-8) 

X(t)  + a(t)  w(t-l) 


Summing  up  both  sides  of  (B-8) 


t a(i)  X(i)  e2(i)  t 

V(t)  < Vq  - I + Z a(i)  ^2(i_i) 

i*l  X(i)  + a(i)  w(i-l)  i=l 


or 


t a(i)  X(i)  e2(i)  t 

2 < I a(i) 

i=l  X(i)  + a(i)  w(i-l)  i=l 


^2(i-l)  + Vq 


(B-9) 


Equation  (B-9)  is  used  later  to  derive  most  of  the  estimator  properties. 


Covariance  Convergence 


It  can  be  proved  (Leal  and  Goodwin,  1984)  that  if 


iiS  X(t)  = 1 


(B-10) 
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the  covariance  is  bounded 


||P(t)||  < - 


(B-11) 


converges 

P(t)  = P„ 


(B-12) 


and  satisfies 

lim  P(t-l)  (B-13) 

tiS 0 

X(t)  + a(t)  w(t-l) 

Given  these  general  estimator  properties  more  useful  ones  are  generated 
when  specific  forms  of  ^(t)  are  considered. 


Linear  Deterministic  Systems  Case,  ^(t)  = 0 


For  these  systems  we  take  a(t)  = 1.  It  is  obvious  from  (B-2)  that 


lim 

t-»®. 


e2(t) 


= 0 


(B-14) 


X(t)  + w(t-l) 


Then  it  is  easy  to  show  from  (B-4)  and  (B-14)  the  following: 


i.  |9(t)|  < M V t 

ii.  |9(t)  - 0(t-i)|  -»  0 V finite  i 

iii.  |e(t)|  < Si(t)  + S2(^)  |x(t-l)i 
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If,  also, 


X(t)  = 1 


we  have 


iv.  liS  P(t)  = P„ 


(B-15) 


V.  e(t)  = 0„ 


Properties  (i)-(iii)  are  well  known  and  can  be  found  in  any  standard 
textbook  for  adaptive  control  (e.g.  Goodwin  and  Sin,  1984,  p.  69).  Proof 
for  (iv)  nad  (v)  can  be  found  in  Leal  and  Goodwin  (1984).  Property  (v) 
means  that  the  estimated  parameters  converge  but  not  necessarily  to  the 
true  ones. 

Bounded  Disturbance  Csae 


Consider  that  ^(t)  is  a bounded  sequence  such  that 


sup  I ^(t) I < A 


In  this  case,  the  following  choice  for  a(t) 


/ 


\iin 


min  - n 

> 

1 + w(t-l) 


(B-16) 


1 if 


a(t)  = « 


0 otherwise 


\ 
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allow  us  to  prove  similar  properties  for  the  estimator  as  in  the  ^(t)  = 0 
case. 

These  properties  are  summarized  in  the  following  Lemma  B.l.  The 
proof  is  included  since  Lemma  B.l  has  not  been  proved  in  the  literature 
for  the  estimator  described  in  (B-4). 

Lemma  B . 1 


Consider  the  system  given  by  (B-1)  and  the  estimator  described  by 
(B-4)  and  (B-16).  Further,  assume  that 

sup  |^(t)|  < A 
and 

X(t)  = 1 

Then  the  estimator  has  the  following  properties; 
i.  |0(t)|  < Ml  < ® 
e2(t) 

ii.  < M2  < 0 

X(t)  + w(t-l) 

iii.  Jis  |e(t)  - 9(t-i)|  =0  i < M 

iv.  |e(t)|  < M3  + 8(t)  |x(t-l)| 

where  0 < S(t)  < ® and  lim  S(t)  = 0 
and  0 < M3  < ® 
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Also 

|y(t)|  < M3 
where 

y(t)  = y(t)  - xT(t-l)  0(t) 

is  the  aposterlori  prediction  error. 


V.  iis  a(t) 

^in 

.1  + w(t-l) 

Proof. 

i.  It  is  obvious  from  (B-8)  and  (B-16)  that  the  Liapunov  function  V(t) 
satisfies 

V(t)  - V(t-l)  < 0 (B-18) 

Since  X(t)  = 1,  P(t)  is  bounded.  Then  (B-8)  and  (B-5)  imply 
that  |0(t)l  is  bounded.  The  algorithm  modification  (B-16)  is  the 
key  to  the  proof  here.  It  was  specifically  designed  to  make  (B-18) 
possible. 

ii.  If  a(t)  = 0,  then  (B-16)  ensures  that 

e2(t)  1 + w(t-l)  a2 

< < M2 

X(t)  + w(t-l)  X^in  + w(t-l) 

Otherwise,  a(t)  = 1 and  from  (B-8)  we  obtain 
X(t)  e2(t) 

< V(t-l)  - V(t)  + a2 


X(t)  + w(t-l) 


169 


From  (B-18) 


V(t-l)  - V(t)  < Vq  - V(t)  < Vo 
so 

e2(t)  Vq  + a2 

< < M2 

X(t)  + w(t-l) 

q.e.d. 


ill.  From  (B-4.1) 


|0(t)  - e(t-l)|2  = a2(t)  |k(t-l)|2  s(t-l) 


e2(t) 


(B-19) 


s(t-l) 

where  s(t-l)  = X(t)  + w(t-l).  From  (B-13)  and  (B-4.2)  follows  that 
JiS  a(t)  |k(t-l)|2  s(t-l)  = 0 

and  property  (iii)  follows  easily  from  (B-19)  and  property  (il). 


iv.  From  (B-4.3)  and  (B-4.4) 

S(t)  = xT(t-l)  0(t-l)  + ^(t-1) 


(B-20) 


and  similarly 

y(t)  = xT(t-l)  0(t)  + ^(t-1)  (B-21) 

Subtracting  0 from  both  sides  of  (B-4.1)  and  premultiplying  by 
x'^(t-l)  we  obtain 


U(t)  = 8(t)  + a(t)  x'^(t-l)  k(t-l)  8(t) 
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and  using  (B-4.2) 


y(t)  = 


X(t)  e(t) 


X(t)  + a(t)  w(t-l) 


which  in  view  of  (ii)  gives 


|y(t) I < M3 


M2 


^lin- 


1/2 


(B-22) 


Subtracting  (5-21)  from  (5-20)  we  have 


e(t)  = y(t)  + [0(t-l)  - 0(t)]T  x(t-l) 


which  in  view  of  (iii)  and  (B-22)  results  to 


|e(t)|  < M3  + 5(t)  |x(t-l| 


where 


5(t) 


= JiS  |0(t-l)  - 0(t)|  = 0 


V.  From  (B-9) 


Z a(i) 
i=l 


\iin 


- 


1 + w(i-l) 


< Vo 


which  implies 


Xjnin  £ (t)  „ 1 

- a2  I = 0 

.1  + w(t-l)  J 


a(t) 
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Asymptotically  Zeroing  Disturbances 


Assume  ^(t)  is  a bounded  sequence  which  satisfies 


Z „ 

i=0 


and 


Ut)  = 0 


Then,  from  (B-9)  we  obtain 


e2(t) 

= 0 

X(t)  + w(t-l) 


and  the  same  properties  as  in  the  deterministic  case  are  valid. 


Forgetting  Factor 


(B-23) 


(B-24) 


Following  Fortescue  et  al.  (1981),  the  forgetting  factor  X(t)  is 
given  by: 


X(t)  = max  {X(t),  X„jin} 


and 

a(t)  e2(t)  a2  ■ 

X(t)  = 1 - - 

Sq  Li  + w(t-l)  \nin- 


where  Sq  is  a positive  constant. 

It  is  seen  from  property  (v)  of  Lemma  B.l  that 


(B-25) 


iis  X(t)  = 1 


(B-26) 
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which  is  required  for  proving  properties  (i)-(iv)  in  Lemma  B.l.  Note 
that  the  only  requirement  for  X(t)  in  the  proof  of  (v)  in  Lemma  B.l  is 

< X(t)  < 1 

Modified  Recursive  Least  Squares 
Estimator  for  Adaptive  MDC 

The  usual  least  squares  estimator  given  by  (B-4)  is  employed.  This 
estimator  satisfies  the  properties  E1-E3,  E6  stated  in  section  6.4. 

Pointvise  Stabilizability  (Leal  and  Goodwin,  1984) 

Let  N(t)  represent  the  Sylvester  eliminant  of  (6-18).  Then,  if 
|det  (N(t))|  <5  5 > 0 

modify  the  parameters  using 

0(t)  = 0(t)  + P(t)  z(t)  (B-27) 

where  z(t)  is  a bounded  vector,  and  form  N(t),  the  new  Sylvester 
eliminant  based  on  0(t).  A z(t)  that  satisfies 

Idet  (N(t))|  > 5 

can  be  found  by  a finite  trial  and  error  search. 

Constrained  Least  Squares  Algorithm  (Goodwin  and  Sin,  1984,  p.  92) 


If 

|B(1)  < 
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then  project  the  estimates  on  the  hyperplane 

B(l)  = sign  (B(D)  b„,in  (B-28) 

This  is  achieved  using  (B-27)  where  z(t)  is  given  as  described  in  Goodwin 
and  Sin  (1984,  p.  94). 

It  is  shown  in  Leal  and  Goodwin  (1984)  and  in  Goodwin  and  Sin  (1984) 
that  the  above  modifications  do  not  affect  the  other  properties  of  the 
parameter  estimator. 


APPENDIX  C 

PROPERTIES  OF  MDC  POLE  PLACEMENT  ALGORITHM 
Consider  the  MDC  pole  placement  Bezutian  equation 

T = AQ  + BP  (C-1) 

where  A,  B,  T are  known  polynomials,  and  Q,  P are  found  as  the  solution 
of  (C-1). 

Let 

A(z)  = aQ  + a^  z~^  + a£  z“^  + ...  + 

B(z)  = z“^  (bo  + z~^  + ...  + b^  z“^) 

T(z;r)  = ao  + r a]^  z~^  + a2  z~^  + ...  + r^  a^  z~^ 

The  minimal  solution  of  (C-1)  is  obtained  if 

deg(Q)  =nq=l+k-l 
deg(P)  = np  = n - 1 
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Then,  let 


Q(z)  = qo  + qi  z 1 + ...  + q„^  z 


P(z)  - Pq  + Pi  z-^  + 


and  define 


* [QO  'll  • • • ‘In  PO  Pi 
P 


Pn  [(n+l+k)  X 1] 

P 


■Cl(r)  = [aQ,  r ai,  ...,  r"  a^,  0 ...  0]'^  [(n+l+k)  x 1] 

The  solution  of  the  Bezoutian  (C-1)  is  given  by  the  system  of  linear 
equations 


where  M is  the  Sylvester  Eliminant  matrix  for  the  polynomials  A(z),  B(z). 
Its  entries  are  the  coefficients  of  A(z),  B(z). 

Noting  that  the  leading  coefficients  of  A(z)  and  T(z)  are  the  same 
and  k > 1,  we  can  show  easily  that  qQ  = 1.  Then  (Goodwin  and  Sin,  1984, 
p.  482)  we  can  rewrite  (C-2)  as 


Ti  = M wi 


(C-2) 


T = a + Nw 


(C-3) 
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where 


w = [qi  q2  ...  Qn  Po  Pi  •••  Pn 
P P 

a = [ai  a.2  ...  Sn  ® •••  [(n+1+k.-l)  x 1] 

X = A(r)  a = [ rai,  a2»  ...|  r*^  a^j,  0 ...  O]*^ 


A(r)  = 


0 


(C-4) 


and  N is  obtained  from  M if  we  omit  the  first  row  and  column. 
From  (C-3)  the  unknown  vector  w is  found  from 


w(r)  = - N-1  [I  - A(r)]  a 


(C-5) 


Note  that  we  can  write 


I - A(r)  = (1  - r)  Ai(r) 
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and  substituting  back  to  (C-5)  we  obtain 

w(r)  = - (1  - r)  N-1  Ai(r)  a (C-5) 

In  view  of  (C-5)  we  can  express  P(z)  and  Q(z)  as 

P(z)  . ( 1 - r)  P(z)  (C-6) 

Q(z)  = 1 + (1  - r)  Q(z)  (C-7) 

Equation  (C-6)  is  useful  in  proving  the  robustness  of  MDC  law. 


APPENDIX  D 

PROPERTIES  OF  TIME  VARYING  LINEAR  DISCRETE  OPERATORS 


Consider  the  time  varying  operator  polynomials  in  the  backwards 
shift  operator  q~^, 


A(t,q~l)  = ao(t)  + ai(t)  q ^ + ...  + ajj(t)  q 


-1 


,-n 


B(t,q"^)  - bo(t)  + bi(t)  q"-*^  + ...  + b„,(t)  q 


-1 


,-m 


C(t,q  = co(t)  + ci(t)  q ^ + ...  + c^Ct)  q“^ 


Define  the  operator  product 


n m 


A(t,q-l)  B(t,q-1)  = I E ai(t)  b.(t)  q-i‘j 

i j 


(D-1) 


and  the  operator  convolution 


A(t,q-1)  • B(t,q-1)  = E E a^(t)  b.(t-i)  q-i~j 

i j 


n m 


(D-2) 


Let  y(t)  be  a time  sequence  and  define  the  operator-sequence  product  as 


A(t,q  1)  y(t)  = E aj(t)  y(t-i) 
i=0 
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The  operator  product  and  convolution  satisfy  the  properties  given  in 
Lemma  D.l  (henceforth  q~^  is  suppressed). 

Lemma  D.l 


Given  the  linear  discrete  time  varying  operators  A(t),  B(t),  C(t) 
and  a time  sequence  y(t),  the  following  are  true: 

i.  The  operator  product 

a.  is  commutative 

A(t)  B(t)  = B(t)  A(t)  (D-3) 

b.  satisfies 

[A(t)  B(t)]  y(t)  #A(t)  [B(t)  y(t)]  (D-4) 

c.  is  distributive  with  respect  to  addition 

A(t)  [B(t)  + C(t)]  = A(t)  B(t)  + A(t)  C(t)  (D-5) 

ii.  the  operator  convolution 

a.  is  non-commutative 


A(t)  • B(t)  B(t)  • A(t)  (D-6) 

b.  is  associative 

[A(t)  • B(t)]  y(t)  = A(t)  [B(t)  y(t)]  (D-7) 

c.  is  distributive  with  respect  to  addition 

A(t)  • [B(t)  + C(t)]  = A(t)  • B(t)  + A(t)  • C(t)  (D-8) 

iii.  Satisfies 

AAB(t)  5 A(t)  B(t)  - A(t)  • B(t) 
n m 

= E E ai(t)  [bj(t)  - bj(t-i)]  q-i"j  (D-9) 


iv.  A(t)  • B(t)  = B(t)  • A(t)  + ABA(t)  - AAB(t) 


(D-10) 
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Proof. 

i.  a,b  are  obvious  from  definition  (D-1)  and  c follows  from  the  fact 
that  the  operators  are  linear. 

ii.  a.  It  is  obvious  from  definition  (D-2). 
b.  From  (D-2) 


n m 

[A(t)  • B(t)]  y(t)  = Z Z ai(t)  b4(t-i)  y(t-i-j) 

i j 


= Z ai(t)  q-i  " bj(t)  y(t-j) 
i j 


= A(t)  [B(t)  y(t)] 


c.  Follows  easily  from  (D-2)  and  operator  linearity. 


iii.  From  definition  (D-9)  using  (D-1)  and  (D-2)  we  have 


n m n m 

AAB(t)  = Z Z aj(t)  bj(t)  - Z Z ai(t)  bj(t-i)  q-^'J 

i j i j 


= Z Z ai(t)  [bj(t)  - bj(t-i)]  q-i-j 

i j 


iv.  From  (D-9) 


A(t)  B(t)  = A(t)  • B(t)  + MB(t) 
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and 

B(t)  A(t)  = B(t)  • A(t)  + ABA(t) 
and  (D-10)  follows  in  view  of  (D-3). 

The  properties  of  Lemma  D.l  are  used  in  the  following  to  prove  Lemma 
6.1,  for  the  adaptive  MDC  law. 

Lemmas  6.1  - Proof 

Recall  that  in  the  non-adaptive  case  the  closed-loop  equations  are 
given  by  (5-9)  and  (5-10).  Similarly,  consider  here  the  linear  time 
varying  operator  T(,(t)  defined  from 


Tc(t)  = A(t)  H(t)  + B'(t)  K(t) 


(D-11) 


It  is  easy  to  show  using  (6-14)  to  (6-16)  that 


Tc(t)  = B_(t)  Fo(t)  T(t)  + B(t)  K(t) 


(D-12) 


where 


B(t)  = B'(t)  - B(t) 


(D-13) 


We  shall  try  to  derive  a closed-loop  model  for  the  system  of  (6-1)  and 
(6-13)  which  is  based  on  (D-11). 
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We  proceed  first  for  the  system  output.  From  (D-11)  we  obtain 

* A A A A 

Tc(t)  y(t)  = [A(t)  H(t)]  y(t)  + [B'(t)  K(t)]  y(t)  (D-14) 

which  in  view  of  (D-3),  (D-9),  and  (D-7)  becomes 

^ A A A A A A 

T^(t)  y(t)  = H(t)  [A(t)  y(t)]  + B(t)  [K(t)  y(t)]  + AHA(t)  y(t) 

+ AB'K(t)  (D-15) 

It  is  easy  to  prove  from  (6-5)-(6-7)  and  (6-40)  that 

A(t)  y(t)  = B(t)  u(t)  + d(t)  + n(t)  (D-16) 

which  if  substituted  in  (D-15),  gives 

^ AA  AA  AAA 

Tc(t)y(t)  = H(t)[B'(t)u(t)]  + B'(t)[K(t)y(t)]  + H(t)d(t)  + H(t)n(t) 

+ AHA(t)y(t)  + AB'K(t)y(t)  (D-17) 

Using  (D-7)  and  (D-10)  to  reverse  H(t)  • B'(t)  we  obtain 

^ A A A AAA 

T^(t)y(t)  = B'(t)  [H(t)u(t)  + K(t)y(t)]  + H(t)d(t)  + H(t)Dt) 

A A A A 

+ AHA(t)y(t)  + AB'K(t)y(t) 

+ AB'H(t)u(t)  - AHB'(t)u(t) 
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Finally,  from  (6-12)  and  the  above  we  obtain 

Tc<t)y(t).  = B'(t)  [R(t)ysp(t)]  + H(t)d(t)  + H(t)n(t)  + (D-18) 

+ [AHA(t)  + AB'K(t)]  y(t)  + [AB'H(t)  - AHB'(t)]  u(t) 

The  closed-loop  equation  for  the  control  variable  is  obtained  in  a 
similar  fashion  staring  from 

Tj,(t)  u(t)  = [A(t)  H(t)]  u(t)  + [B'(t)  K(t)]  u(t) 

and  is  given  by 

T^,(t)  u(t)  = A(t)  [R(t)  ysp(t)]  - K(t)  d(t)  - K(t)  h(t)  (D-19) 

+ [AAK(t)  - AKA(t)]  y(t)  + [AAK(t)  + ^'(t)]  u(t) 

Combining  (D-18),  D(19),  and  (D-22)  Lemma  6.1  is  obtained. 

Next  a Lemma  is  presented  concerning  properties  of  slowly  time 
varying  operators.  They  are  needed  in  proving  Lemma  D.2  and  Lemmas  6.2, 
and  6.4. 

Definition  1.  We  say  that  the  operator  A(t,q“^)  is  bounded  iff 
laj(t) |<“  Vt  i=0,  ...,n 
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Definition  2.  We  say  that  the  operator  A(t,q"^)  is  slowly  time 
varying  iff 

lai(t+l)  - ai(t)|  =0  i = 0,  n 

Lemma  D.2 

1 1 —1 

Consider  the  time  varying  operators  A(t,q~-*^),  B(t,q“-^),  C(t,q 
Then,  the  following  are  true: 

i.  Suppose  that  both  A(t,q"^)  and  B(t,q“^)  are  bounded  and  slowly  time 
varying.  Then  the  operators 

C(t,q-1)  = A(t,q-1)  B(t,q-1)  <D-20) 

D(t,q"l)  = A(t,q"^)  + B(t,q"^)  (D-21) 

are  also  bounded  and  slowly  time  varying, 
ii.  Suppose  that  C(t,q~^)  with  leading  coefficient 
lco(t)|  > e > 0 

is  bounded  and  slowly  time  varying.  Then  the  monic  polynomials 


A(t,q~^)  and  B(t,q"^)  satisfying 
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C(t,q  = CQ(t)  A(t,q  B(t,q 


n/i-  n-1' 


(1 


are  bounded  and  slowly  time  varying. 


Proof. 


i.  Since  A(t,q  ^),  B(t,q  are  bounded  and  slowly  time  varying,  : 
true  from  definitions  1 and  2 that 


|ai(t+l)  - ai(t)|  = 0 |ai(t)|  < 


(I 


li™  |bi(t+l)  - bi(t)l  = 0 |bi(t)|  < « 


(1 


From  (D-20)  the  coefficients  cj(t)  of  C(t,q  are  given  by 


Ci(t)  = I ai^.(t)  bi_j,.(t) 

k=0 


(1 


In  view  of  (D-23)  and  (D-24)  it  follows 


|ci(t)|  < 


From  (D-25)  we  obtain 


Ci(t+1)  - Ci(t)  = E [ai5.(t+l)  bi_i5.(t+l)  - ai^(t)  bi_j^(t)] 

k=0 


1-22) 


it  is 


1-23) 


1-24) 


1-25) 
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or 


|Ci(t+l) 


Ci(t) 


< Z 

k=0 


[|bi_k(t+D 


bi_k(t)||ak,(t)|  + 


|ak(t+l)  - ak(t)||bi_k(t+l)|] 
and  using  (D-23)  and  (D-24) 

iiS  |ci(t+l)  - Ci(t)|  = 0 

Thus,  C(t,q“^)  is  bounded  and  slowly  time  varying. 

From  (D-21) 

di(t)  = ai(t)  + bi(t) 

It  is  trivial  to  show  that 

|di(t)|  < ® 

and 

JiS  |di(t+l)  - di(t)|  = 0 

ii.  Consider  (D-22)  as  a factorization  of  C(t,q“^)  and  let  Zj^(t) 
represent  its  i^b  zero.  We  shall  show  first  that  all  zeroes  of 
C(t,q~^)  are  bounded  and  slowly  time  varying.  Any  z^^(t)  satisfies 
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co<t)  z}(t)  + ci(t)  z}  ^(t)  + ...  + ci(t)  = 0 


(D-26) 


Since  |cQ(t)|  > e > 0 |zj^(t)  is  bounded.  Similarly  to  (D-26)  at 

time  t + k we  have 


Co(t+k)  z}(t+k)  + ci(t+k)  z}  ^(t+k)  + ...  + c^Ct+k)  = 0 


(D-27) 


Subtracting  (D-26)  for  (D-27)  and  factoring  we  obtain 

[Zi(t+k)  - zj(t)]  {other  terms  ^ 0}  = (cQ(t+k)  - CQ(t))  zjl(t+k) 

(D-28) 

+ ...  + (ci(t+k)  - c^(t)) 

Since  C(t,q~^)  is  slowly  time  varying  and  z^(t+k)  is  bounded,  it 
follows  from  (D-28)  that 


(D-29) 


|zj(t+k)  - Zi(t)|  = 0 


Now,  A(t,q~^)  and  B(t,q“^)  can  be  expressed  as  products  with  factors  (1- 
zj(t)q~^)  which  are  bounded  and  slowly  time  varying.  Then,  the  first 
part  of  Lemma  D.2  implies  that  both  A(t,q“^)  and  B(t,q~^)  are  bounded  and 
slowly  time  varying. 

Lemmas  concerning  the  properties  of  the  adaptive  MDC  time  varying 
polynomials  are  presented  next. 
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Lemma  D.3 

If  the  estimator  properties  E1-E6  are  valid  then  the  following  are 

true: 

i*  le(t)|  > Pmin  > 0 

ii.  the  adaptive  MDC  law  polynomials  Q(t,q“^),  P(t,q“^)  and  K(t,q“^)  are 
bounded 

iii.  there  exists  e^^niax  ^ ® ^he  polynomial  T(,(t,q“^)  which  is 

obtained  by  taking  = ®l,max  stable  for  every  time  t 

iv.  the  MDC  law  polynomials  B_(t),  B^.(t),  S^(t),  C(t),  T(t),  P(t),  Qx(t) 
are  all  bounded  and  slowly  time  varying 
V.  the  MDC  law  operators  H(t),  K(t),  R(t)  are  bounded  and  slowly  time 

varying. 

Proof. 


i.  From  the  estimator  property  E5 

|B'(1)|  > bjiXjj  (D-30) 


From  (6-29)  and  (6-34)  we  obtain 
|B'(1)|  < |B(1)|  + 1 ex 


Using  (D-30)  and  step  0 of  the  algorithm 

bmin  (1  - i)  < |B(1)| 

1 
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In  view  of  (6-9)-(6-12) , the  above  equation  implies  that 


or 


I0(t)l  > b„,in  (1  - -) 


i=l  |l-zj 


i=l  ll-l/z+l 


> Pmin  > 0 


ii.  Consider  first  the  Bezoutian  equation  (6-18) 


T(t)  = C(t)  Qi(t)  + B^(t)  P(t) 


It  is  proved  in  Appendix  C that  (6-18)  is  equivalent  to  (equation 
(C-5)) 


w(t)  = - N l(t)  [I  - A(r(t))]  a(t)  (D-31) 

where  w(t)  is  a vector  with  entries  the  coefficients  of  Qi(t)  and  P(t), 
a(t)  is  a vector  containing  the  coefficients  of  C(t),  and  N(t)  is  the 
Sylvester  Eliminant  of  (6-18). 

From  (D-31) 

l|N(t)||N-l 

^ (1  - r(t))  |a(t)|  ; N = deg  (N(t))  (D-32) 

|det  (N(t))| 

From  El  and  Remark  6.1  follows  that  C(t)  and  B^(t)  are  bounded,  and 
consequently  ||N(t))||  and  |a(t)|  are  bounded.  In  addition,  property  E4 
implies  that  |det  (N(t))|  is  bounded  away  from  zero.  Then,  it  follows 
from  (D-32)  that  |w(t)|  is  bounded  and  the  same  is  true  for  Q]^(t)  and 
P(t).  Then,  part  (ii)  of  Lemma  D.3  follows  easily  from  (6-19). 
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iii.  Recall  that  a sufficient  condition  for  stability  of  Tj,(t)  is  given 
by  (6-36).  In  view  of  part  (ii)  of  this  Lemma  is  bounded. 

Next  note  that  step  1 and  step  2 of  the  adaptive  MDC  algorithm 
ensure  that  all  zeroes  B_(t)  T_(t)  are  inside  a circle  of  radius  1-a 
in  the  complex  plane.  From  the  latter  and  part  (i)  of  this  Lemma  it 
follows  that  djjiifj  is  bounded  away  from  zero.  Then  (6-36)  implies 
that  there  exists  e^^^ax  > 0 so  that  for  (6-36)  is 

satisfied  for  all  times. 

iv.  The  estimator  property  E6  implies  that  for  any  8 > 0 there  exists  a 
finite  time  tQ  such  that 

(D-33) 

|bi(t)  - bi(to)|  < S(to)  V t > to 

Part  (iii)  of  this  Lemma  and  (D-33)  imply  that  if  there  are  bj's 
that  converge  to  values  smaller  than  Si^max’  then  there  exist  a 
finite  line  tQ  such  that 

I bj  ( t ) I < ^ niax  ^ t > tQ 

- « - 
and  bj(t)  is  not  included  in  B(t,q~^)  for  t > tQ.  This  is 

equivalent  to  k(t)  = k and  m(t)  = m for  t > tg.  Now  from  (D-33), 

(D-28),  (6-26),  and  (6-27)  follows  that  the  m-k  zeroes  of  B(t,q~^) 

satisfy 


|Zi(t)  - Zi(tQ)|  < Si(tQ) 


t > to 


(D-34) 
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which  implies  that  the  number  of  stable  (or  unstable)  zeroes  does 
not  change  after  a finite  time  tQ,  i.e.  li(t)  = 1^, 
l3<t)  = I3  for  t > tQ. 

Now,  having  established  the  convergence  of  the  orders  of 
B(t,q“^),  B_(t,q“^),  and  B^(t,q“^)  in  finite  time,  it  follows  easily 
from  Lemma  D.2  (ii)  and  the  estimator  property  E2  that  B_(t),  B^(t), 

/N 

and  B^(t)  are  slowly  time  varying  polynomials.  Then  using  Lemma  D.2 
(i)  and  (6-39)  it  is  straight-forward  to  show  that  C(t)  and  T(t)  are 
bounded  and  slowly  time  varying. 

Next  we  shall  use  (D-31)  to  show  that  P(t),  Qi(t)  are  also 
slowly  time  varying.  Let 

T(t)  = - [I  - A(r(t))]  a(t) 

and  rewrite  (D-31)  as 

T(t)  = N(t)  w(t) 

from  which  we  obtain 

w(t+l)  - w(t)  = N-l(t)(T(t+l)  - T(t))  - N-l(t)(N(t+l)  - N(t))w(t+1) 

(D-35) 

Since  both  a(t)  and  r(t)  are  slowly  time  varying 

, . (D-36) 

JiS  I |T(t  + l)  - T(t)|  I = 0 

Similarly  from  property  E2 


JiS  I |N(t+l)  - N(t)| I = 0 


(D-37) 
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In  view  of  (D-36)  and  (D-37)  we  obtain  from  (D-35) 

|w(t+l)  - w(t)|  = 0 

or  Q]^(t)  and  P(t)  are  slowly  time  varying  polynomials. 

V.  This  property  follows  easily  in  view  of  properties  (ii)-(iv)  of  this 
Lemma  and  Lemma  D.2. 

Finally,  we  prove  Lemma  6.4. 

Lemma  6.4  Proof 


From  (6-41)  and  (6-42)  we  have 

ll(t)  = B'(t)  [R(t)  ysp(t)]  + H(t)  n(t)  + H'(t)  d(t) 

(D-38) 

+ [/ffl'K(t)  + AHA(t)]  y(t)  + [AB'H(t)  - MB'(t)]  u(t) 

It  follows  from  E1-E3  and  Lemma  D.3  that  the  first  three  terms  in  the  RHS 
of  (D-37)  are  bounded.  Since  A(t),  B'(t),  H(t),  K(t)  are  all  slowly  time 
varying,  equation  (D-9)  gives 

|[AB'H(t)  - AHB'(t)]  u(t)|  < Y2(t)  ||u(t)||„ 

and 


|[AB'K(t)  + AHA(t)]  y(t)l  < Y2(t)  ||y(t)||a, 
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where 


ti2  Y2(t)  = 0 

Then  (6-41)  follows  easily  and  similarly  (6-42). 
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